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EXECUTIVE  SUMMARY 


OBJECTIVE 

Increasingly  complex  sensor  and  communication  systems  are  being  developed 
and,  as  this  complexity  increases,  the  problem  of  analytically  determining  the  opti¬ 
mum  set  of  rules  or  control  logic  for  these  systems  becomes  computationally  intrac¬ 
table.  For  this  reason,  a  learning  system  is  needed. 

APPROACH 

Artificial  intelligence  (AI)  approaches  to  learning  were  reviewed  for  their 
potential  contributions  to  the  construction  of  a  system  to  learn  parameter  control 
doctrine  (in  this  case,  a  set  of  rules  which  can  be  used  to  control  sensor  or  commu¬ 
nication  systems).  Separate  learning  tasks  were  isolated,  and  the  advantages,  disad¬ 
vantages,  and  limitations  of  the  AI  learning  approaches  relative  to  those  tasks  were 
determined. 

Several  levels  of  related  problems  were  distinguished,  rangingfrom  the 
choice  of  parameters  in  a  given  situation  to  the  design  of  a  system  of  sensors  capa¬ 
ble  of  handling  a  given  set  of  scenarios.  In  order  to  relate  ideas  on  learning  tech¬ 
niques  to  an  application  and  to  uncover  some  of  the  many  aspects  of  the  problem,  a 
simple  agile-beam  air-search  radar  optimization  case  was  chosen.  Formulas  for  pro¬ 
viding  the  learning  system  with  measures  of  its  performance  (e.g.,  relative  to  target 
acquisition  and  track  quality)  were  derived  for  four  kinds  of  targets. 

RESULTS 

A  study  of  the  relative  merits  of  different  representations  led  to  the  selec¬ 
tion  of  a  production  system  architecture  capable  of  learning  control  doctrine,  and 
to  the  conviction  that  functionally  independent  aspects  must  be  represented  and 
accessed  separately.  A  tool  for  constructing  production  system  architectures  from 
basic  building  blocks,  PRISM,  was  obtained  to  facilitate  experimentation  with 
architectures  for  the  learning  system.  One  of  the  learning  systems  that  resulted 
from  this  effort  supports  the  following  four  different  goals:  (1)  if  the  goal  is  to  sat¬ 
isfy  the  constraints  on  the  problem,  a  parameter  setting  is  produced  directly  from 
the  production  memory  that  is  augmented  during  learning  to  improve  its  ability  to 
pick  a  near-optimum  setting  on  the  first  attempt;  (2)  if  the  goal  is  to  obtain  an  opti¬ 
mum  solution,  a  series  of  solutions  are  reported,  with  each  subsequent  solution  an 
improvement  over  the  previous  one,  until  the  user  stops  the  system  from  seeking  a 
better  solution;  (3)  if  the  goal  is  to  learn,  new  productions  are  generated  by  one  pro¬ 
duction  memory  to  augment  those  in  another;  and  (4)  if  the  goal  is  to  monitor  the 
program’s  efforts,  every  step  in  the  decision  of  a  choice  of  parameters  is  reported. 
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INTRODUCTION 


OBJECTIVES 

The  objectives  of  this  research  are  both  theoretical  and  practical.  On  the  theo¬ 
retical  side,  we  seek  to  codify  and  extend  the  basic  theory  and  techniques  of  artificial 
intelligence  (AI)  to  encompass  the  problems  which  arise  in  domains  such  as  radar 
parameter  control  involving  numeric  attributes  embedded  in  a  more  complex  condi¬ 
tional  doctrine  framework.  We  expect  our  orientation  towards  developing  machine 
learning  approaches  to  advance  the  development  of  techniques  for  the  acquisition  of 
knowledge  which  is  not  readily  formalized,  and  to  contribute  to  the  development  of 
tools  for  refining  weak  general  problem-solving  methods  into  strong  domain  specific 
ones.  On  the  practical  side,  we  hope  follow-on  work  can  carry  the  results  of  this 
research  into  eventually  producing  understandable  and  explainable  collections  of 
doctrinal  rules  for  controlling  the  parameters  of  specific  sensor  and  communication 
systems. 

WHY  MACHINE  LEARNING? 

Why  pursue  machine  learning  techniques  for  developing  parameter  control 
doctrine? 

Analytical  methods  are  intractable  because  of  space  or  time  on  complex  prob¬ 
lems.  For  highly  complex  systems  there  are  too  many  options  and  dimensions,  and 
the  computations  are  too  time  consuming.  Heuristics  for  improving  parameter  set¬ 
tings  may  provide  solutions  satisfying  constraints  in  cases  where  we  were  unable  to 
obtain  solutions  before,  and  solutions  of  higher  quality.  The  techniques  may  help  to 
optimize  some  of  the  Navy’s  command,  control,  and  surveillance  functions. 

An  example  of  a  typical  constraint  on  a  solution  is  the  rule  to  reject  any 
parameter  set  that  results  in  a  component  performance  measure  out  of  range  of  its 
allowed  values  (Figure  1).  (In  our  case,  a  parameter  set  will  be  rejected  if  it  exceeds 
its  maximum  allowed  value  since  the  measures  have  been  converted  to  range  from  0 
on  up  and  each  has  a  specified  maximum  allowed.) 


FALSE-TRACK  RATE  (PER  HOUR) 


Figure  1.  Example  of  a  constraint  on  a  component 
performance  measure  -  a  limit  on  false-track  units. 


LEVELS  OF  PROBLEMS 


There  are  three  levels  of  problems.  In  the  first  level,  a  particular  sensor  or 
communication  system  is  functioning  in  a  specific  situation,  and  the  problem  is  to 
optimize  performance  by  appropriately  setting  the  relevant  parameters.  Examples 
of  parameters  which  may  be  set  are  the  direction,  power,  and  frequency  for  a  sensor 
beam. 


In  the  second  level,  instead  of  a  single  situation,  the  system  is  matched  to 
a  set  of  situations/scenarios  and  must  find  a  control  logic  appropriate  for  all  the 
situations  and  scenarios. 

In  the  third  level,  a  system  of  sensors  or  communication  elements  must  be 
designed  to  deal  with  expected  scenarios.  If,  instead  of  a  single  system,  the  designed 
system  is  a  complex  multiple  system,  it  will  have  to  distribute  tasks  among  receivers 
in  addition  to  setting  the  parameters  for  each  receiver. 

To  summarize,  the  levels  of  problems  are  as  follows: 

(1)  Particular  optimization  problem 

Given:  A  particular  sensor  or  communication  system,  fully  described 
(its  specific  capabilities  identified) 

Situation  and  environment 

Requirements  on  a  solution 

Find:  (three  sublevels  of  increasing  difficulty) 

(a)  A  set  of  parameters  which  satisfy  the  requirements  on  a 
solution; 

(b)  A  near  optimum  set  of  parameter  settings;  and 

(c)  The  set  of  parameter  settings  which  optimize  the  performance 
of  the  system. 

(2)  Learning  of  doctrine  for  parameter  control 

Given:  A  fully  described  sensor  or  communication  system 

A  set  of  situations  and  scenarios  it  is  likely  to  face 

Find:  Control  logic  to  make  the  system  function  optimally  or  near 
optimally,  whatever  the  situation  or  scenario. 
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(3)  Design  of  a  system  of  sensors,  given  scenarios 


(a)  A  single  system 

(b)  A  complex  multiple  system,  such  as  an  intercept  system  consisting  of 
several  receivers  for  warning,  analysis,  and  direction  finding,  where  it 
is  necessary  to  divide  the  effort  between  components  of  the  system  as 
well  as  to  set  the  parameters  of  each  component. 
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THE  LEARNING  TASK 

BASIC  REQUIREMENTS  FOR  LEARNING 

The  learning  system  must  be  able  to  do  the  following; 

Generate  alternatives  —  produce  new  behaviors  from  which  to  learn  from  its 

“mistakes.” 

Determine  the  results  when  performance  is 
satisfactory 
unsatisfactory 

better  than  prior  performance  \  for  a  system  attempting  to 

> 

worse  than  prior  performance  /  optimize  performance. 

Attribute  credit  or  blame  to  some  component  of  the  performance  system. 

Modify  its  future  behavior. 

DECOMPOSITION  OPTIONS 

In  tackling  complex  applications,  it  is  advantageous  to  decompose  the 
problems  to  devise  shortcuts  for  finding  their  solutions.  Five  broad  options 
for  decomposition  are  assessed  for  the  problem  or  learning  control  doctrine. 

The  first  option  is  to  break  up  the  effort  by  parameter.  After  generating 
and  solving  a  set  of  subproblems  for  learning  to  set  (or  change)  each  parameter 
separately,  the  resultant  doctrine  for  a  given  parameter  can  be  assembled  with 
collections  of  rules  for  other  parameters  to  form  the  complete  set  of  doctrinal  rules. 
Once  the  doctrine  is  learned,  rules  for  different  parameters  can  be  collapsed  wherever 
they  have  the  same  antecedents  (left  sides),  and  the  consequents  (right  sides)  can  be 
compounded.  Although  this  alternative  sounds  simple,  it  does  have  some  disadvan¬ 
tages.  Parameters  may  not  be  entirely  independent.  Thus,  the  learned  doctrine  for 
a  given  parameter  could  be  affected  by  how  the  other  parameters  are  assumed  to 
be  assigned.  Performance  measures  are  a  function  of  several  parameters  at  once, 
and  optimizing  those  measures  involves  the  simultaneous  modification  of  several 
parameter  values. 

A  second  way  to  decompose  the  learning  problem  is  to  break  it  up  into  a  set 
of  subproblems  for  applying  optimization  techniques  individually,  that  is  for  finding 
conditions  on  the  application  of  the  optimization  techniques.  Again,  the  resulting 
collections  of  doctrine  may  be  assembled  and  integrated.  However,  this  decomposition 
option  is  only  appropriate  for  Task  F  (page  5). 
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A  third  approach  is  to  break  up  the  learning  problem  into  a  set  of  sub¬ 
problems,  one  for  each  performance  measure.  This  will  prevent  us  from  overlooking 
valuable  factors  which  partially  cancel  out  when  all  performance  measures  are  com¬ 
bined  into  the  overall  measure.  We  are  pursuing  this  approach. 

A  fourth  approach  maps  problems  into  simple  representations.  Solutions  to 
simpler  problems  can  function  as  skeletal  solutions  to  more  complex  problems.  Infor¬ 
mation  gleaned  in  solving  simpler  problems  can  be  applied  to  more  complex  problems. 
Additionally,  a  repertoire  of  techniques  for  handling  simpler  problems  can  be  con¬ 
structed  along  with  the  guidelines  for  combining  them  when  tackling  more  complex 
problems.  And,  finally,  we  may  choose  the  most  appropriate  representations  of  the 
problems  for  both  learning  and  performance,  even  if  they  differ  radically,  and  set  up 
mechanisms  to  translate  between  the  representations.  In  this  case,  the  translation  of 
learned  material  can  be  interpreted  as  operationalizing  that  information. 

A  fifth  option  is  to  construct  intermediate  features  which  classify  the  situ¬ 
ation  with  respect  to  the  appropriate  techniques  for  obtaining  performance  goals. 

The  intermediate  features  could  be  either  features  of  parameters  or  features  of  condi¬ 
tions  (situations).  This  move  introduces  new  levels  of  abstraction  in  which  the  num¬ 
ber  of  dimensions  to  consider  is  reduced.  In  some  domains,  dependencies  between 
factors  can  be  found.  Then  it  becomes  possible  to  extract  primitives  from  which 
some  dependent  factors  can  be  derived,  enabling  simplification  of  representations  at 
another  level.  A  technique  called  proportionality  graph  analysis  is  used  to  assess  the 
contribution  of  this  approach. 

Additional  strategies,  which  do  not  fit  so  neatly  under  the  designation  of 
decomposition  options,  such  as  analyzing  extremes,  exploiting  symmetries,  per¬ 
turbation  analysis,  and  finding  analogies  to  solved  problems  are  also  considered. 

SEPARATION  OF  LEARNING  TASKS 

Nine  learning  tasks  have  been  isolated  from  the  domain,  and  designated  as 
Task  A,  Task  B,...  and  Task  I.  What  must  be  learned  for  each  task  is  as  follows: 

Task  A:  Principles  of  assigning  values  to  parameters. 

Task  B:  Principles  of  modifying  parameter  values. 

Task  C:  Intermediate  features  of  conditions  describing  situations 

(characteristics  of  situations  that  occur  together  and  that  have  the 
same  significance  for  parameter  control  decisions). 

Task  D:  Intermediate  features  of  parameters  (settings  or  changes  of  values 
to  be  made  together). 

Task  E:  Equivalent  units  to  use  in  balancing  different  performance 
measures. 

Task  F:  Heuristics  to  use  in  applying  performance  optimization  techniques. 

Task  G:  Empirically  discoverable  quantitative  relationships  between 
performance  measures  and  parameter  values. 


Task  H:  Principles  for  diagnosing  a  situation  as  one  of  a  type  requiring  a 
specific  approach  or  treatment. 

Task  I:  Paradigm  situations  to  draw  upon  via  analogy  to  determine 
parameter  settings  or  changes. 

This  project  addresses  Tasks  A  through  D. 

COMPONENTS  OF  EMPIRICAL  LEARNING 

Learning  from  experience  involves  the  following  four  subproblems:  aggrega¬ 
tion,  clustering,  characterization,  and  storage  or  indexing. 

The  aggregation  problem  consists  of  identifying  the  objects  and  their  attri¬ 
butes  (or  entities)  from  which  concepts  will  be  formed.  These  are  the  objects  or  enti¬ 
ties  on  which  learning  will  take  place.  To  solve  this  problem  the  learner  must  identify 
part-of  relations. 

The  clustering  problem  consists  of  identifying  which  objects,  entities,  or 
events  should  be  grouped  together  into  a  class  to  generate  an  extensional  definition 
of  the  concept  to  be  learned.  The  learner  must  identify  instance-of  relations  to  solve 
this  problem. 

The  characterization  problem  consists  of  formulating  some  general  description 
or  hypothesis  that  characterizes  the  instances  of  the  concept.  The  learner  solves  this 
problem  by  generating  an  intensional  definition  of  the  concept. 

The  storage  or  indexing  problem  arises  for  learners  that  need  to  use  the 
knowledge  they  acquire.  The  characterization  generated  in  solving  the  last  problem 
most  be  stored  so  that  it  may  be  retrieved  and  employed  in  the  performance  of  tasks. 

SETS  OF  RULES 

Performance  Set 

Conditions  are  descriptions  of  the  situation. 

Actions  are  suggested  parameter  settings. 

This  set  is  the  parameter  control  rules  system. 

Learning  Set 

Conditions  are  descriptions  of  parameter  setting  cases  and  their  associated 
performances. 

Actions  consist  of  adding  rules  to  the  performance  rule  set  or  altering  the 
weights  of  rules  already  part  of  the  set. 


THE  RULE  LEARNER 


The  rule  learner  is  a  collection  of  mechanisms  for  the  following; 

generating  new  rules  (often  variants  of  existing  rules); 

weighting  rules.  (If  they  are  relearned  or  used  advantageously,  they 
may  be  strengthened.); 

abstracting  to  more  general  rules; 

discriminating  poor  rules.  (Making  more  specific  variants  in  response 
to  finding  differences  between  contexts  in  which  a  given  rule  suggests 
less  valuable  actions,  and  contexts  in  which  this  rule  suggests  more 
valuable  actions.); 

proceduralizing  memory  elements  to  form  rules; 

composing  rules  into  a  single  rule  where  they  fire  in  sequence;  and 

open-ended  possibilities  for  the  construction  of  arbitrary  LISP  (or 
other)  functions  to  encode  additional  techniques  as  needed. 

APPROACHES  TO  TASKS 

Solutions  to  the  Aggregation  Problem 

There  are  several  ways  to  look  at  the  learning  tasks.  For  example,  various 
solutions  to  the  aggregation  problem  can  be  seen  as  differentiating  Task  A  through 
Task  D  and  Task  F  (page  5).  If  individual  cases  or  instances  are  chosen  as  the  entities 
on  which  learning  will  occur,  we  will  have  a  collection  of  cases  each  consisting  of  a 
set  of  values  for  situation  variables  and  already  set  parameter  values.  Among  the 
values  could  be  included  the  performance  measures  taken  of  results  of  the  setting 
event.  Thus,  we  would  have  the  right  ingredients  for  learning  intermediate  features 
of  conditions  describing  situations  as  in  Task  C. 

If,  instead  of  individual  cases,  entities  become  pairs  of  cases  combined  with 
the  associated  information  on  performance  measures,  we  can  accomplish  Task  A 
(learning  the  principles  for  assigning  values  to  parameters,  given  the  situation).  Indi¬ 
vidual  cases  of  changes  in  parameter  settings  form  the  entities  for  Task  D  enabling 
us  to  learn  the  intermediate  features  of  parameter  changes  to  be  made  together. 

Pairs  of  cases  of  changes  in  parameter  settings  allow  us  to  tackle  Task  B  and  learn 
the  principles  for  modifying  parameter  values.  The  entities  needed  for  Task  F  are 
traces  of  the  application  of  a  curve-fitting  or  other  numerical  technique  to  a  domain 
optimization  problem. 

Solutions  to  the  Clustering  Problem 

The  solution  to  the  Task  A  clustering  problem  involves  assembling  the  pairs 
on  the  basis  of  whether  the  parameter  settings  meet  the  constraints  on  solutions,  and 
on  the  basis  of  their  ratings  on  the  performance  measures.  There  will  be  a  minimum 
of  four  classes  of  pairs:  (1)  a  class  to  place  pairs  if  both  fail  to  meet  the  constraints 
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on  a  solution;  (2)  a  class  to  encompass  pairs  of  which  one  is  a  viable  solution  and  the 
other  is  a  failure  to  meet  the  constraints  on  a  solution;  (3)  a  class  to  place  pairs  of 
instances  where  both  are  solutions,  but  one  has  a  better  overall  performance  measure 
than  the  other;  and  (4)  a  class  of  pairs  of  solutions  each  having  equivalent  ratings  on 
the  overall  performance  measure.  Using  the  relationship  of  the  performance  measures 
for  each  of  the  two  cases  in  the  pair,  we  can  examine  two  classes  for  each  perform¬ 
ance  measure,  one  instance  as  better  vs.  both  equivalent  in  performance.  However, 
these  will  be  overlapping  classes  and  will  need  to  be  handled  in  special  ways.  There  is 
also  the  option  of  using  the  balance  of  the  performance  measures  in  clustering  the 
pairs. 


For  Task  B,  the  pair  clustering  results  in  three  classes.  Both  parameter 
changes  may  show  an  improvement  in  performance  measures,  both  may  be  degraded, 
or  one  may  be  improved  and  one  degraded.  Finer  distinctions  may  be  made  on  the 
relative  performance  measure  changes  in  each  instance,  on  which  performance  meas¬ 
ures  are  involved  and  how  they  are  improved  or  not  in  efforts  to  achieve  balance. 

The  solutions  to  the  clustering  problem  for  Tasks  C  and  D  also  use  the  per¬ 
formance  measures,  and  even  more  gradations  are  possible  in  the  approach  to  these 
tasks.  The  performance  measures  can  extensionally  identify  a  minimum  of  two  classes 
above  and  below  a  threshold  value  for  the  performance  measure  where  we  select 
a  single  cutoff,  or  we  may  use  multiple  cutoffs  for  the  desired  number  of  classes. 

After  characterizing  the  clusters  symbolically  using  observable  attributes,  the  pro¬ 
cess  of  clustering  and  characterizing  continues  by  generating  subclassifications  of 
the  clusters  for  each  parameter  setting. 

Solutions  to  the  Characterization  Problem 

The  concept  to  be  learned  for  Task  A  is  a  complex  disjunctive  relational  con¬ 
cept,  “< parameter  setting>  is  good  for  <  situation  >”.  This  ‘is  good  for’  concept 
can  be  interpreted  in  multiple  ways  as  expressing  quality  for  an  overall  performance 
measure  or  for  each  separate  performance  measure,  thereby  heralding  a  series  of 
concepts. 

Likewise  for  Task  B,  the  concept  to  be  learned  is  “<  parameter  setting> 
improves  <  performance  measure  >  in  <  situation  >”.  If  the  overall  performance 
measure  is  assumed,  <  performance  measure  >  need  not  be  explicit  in  the  relation. 

Initial  rules  for  setting  parameters  can  be  treated  as  hypotheses  and  used  to 
predict  whether  an  instance  will  be  positive  or  negative.  Such  predictions  can  be 
divided  into  four  classes: 

A  description  can  correctly  match  against  a  positive  instance  of  the  concept 
being  learned.  Using  Task  B  for  the  example,  a  parameter  change  which  leads  to  an 
improvement  in  performance  can  be  seen  as  a  positive  case  of  the  rule  which  proposes 
it. 


A  description  can  correctly  fail  to  match  against  a  negative  instance  of  the 
concept  being  learned.  None  of  the  rules  should  match  cases  in  which  a  parameter 
change  leads  to  a  degradation  of  performance. 
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A  description  can  incorrectly  fail  to  match  a  positive  instance  of  the  concept. 
This  is  called  an  error  of  omission,  and  suggests  that  the  hypothesis  or  rule  is  too 
specific. 

A  description  can  incorrectly  match  against  a  negative  instance  of  the  concept. 
This  is  called  an  error  of  commission,  and  suggests  that  the  hypothesis  or  rule  is  too 
general.  The  rules  should  not  propose  parameter  changes  that  degrade  performance. 

Solutions  to  the  Storage  or  Indexing  Problem 

The  representation  of  acquired  knowledge  for  Tasks  A,  B,  and  F  will  reflect 
the  need  for  the  use  of  that  knowledge  in  the  production  system  architecture.  On  the 
macrolevel,  this  information  is  stored  in  disjunctive  rule  choices,  while  on  the  micro¬ 
level,  it  is  entered  as  production  rules.  We  implement  rules  which  themselves  have 
action-sides  specifying  that  additions  and  changes  be  made  to  certain  procedural 
memories.  Some  of  the  learned  material  is  hidden  in  alterations  to  activation  values 
or  strengths  associated  with  already  present  rules.  This  will  be  discussed  in  more 
detail  under  the  description  of  the  PRISM  architecture  building  system. 

For  Tasks  C  and  D,  concepts  are  constructed  which  may  be  added  both 
to  object  hierarchies  and  to  the  individual  cases  as  new  attribute-value  pairs.  At 
present,  the  additions  are  not  made  automatically  during  the  functioning  of  the 
learner  as  they  are  for  Tasks  A  and  B,  but  must  be  done  by  hand  in  setting  up  the 
representations  for  the  instances  and  in  constructing  the  hierarchies. 

There  are  a  variety  of  alternatives  for  indexing  and  recognizing  concepts 
stored  hierarchically.  One  of  the  best  approaches  appears  to  be  Gluck  and  Corter’s 
(1985)  category  utility  which  measures  the  average  extent  to  which  knowledge  of 
category  membership  increases  certainty  about  the  attribute  values  of  category 
members.  Formally,  given  a  partition  {Cl,  C2,...,Cn}  over  a  set  of  objects  which 
have  attributes  Ai  with  possible  values  Vij,  category  utility  equals: 


This  value  is  used  as  a  measure  of  the  quality  of  concepts  in  an  incremental 
concept  formation  system,  COBWEB/1  (Fisher,  1986). 

DESIRED  FORM  OF  LEARNED  DOCTRINE 

Since  we  wish  to  generate  doctrine  for  use  by  humans,  we  have  been  most 
attracted  to  doctrine  as  expressed  in  rules.  Learning  systems  can  very  naturally  be 
expressed  using  rule-based  systems. 
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Overview  of  Production  Systems 


In  terms  of  structure,  production  systems  consist  of  two  main  components: 

(1)  a  dynamic  working  memory  containing  the  current  state  of  knowl¬ 
edge  in  the  problem  solving  effort;  and  (2)  a  more  stable  production 
memory,  stated  as  a  set  of  condition-action  rules  or  productions; 

In  terms  of  behavior,  production  systems  have  three  main  processing  stages: 

(1)  the  match  process,  in  which  conditions  of  rules  are  matched  against 
the  contents  of  working  memory  to  determine  what  rules  will  be 
applicable  to  the  current  problem;  (2)  the  conflict  resolution  process,  in 
which  some  rules  are  selected  for  application;  and  (3)  the  act  process, 
in  which  selected  rules  are  executed. 

Production  systems  operate  in  cycles,  with  actions  on  one  cycle  leading  to  new 
matches  on  the  next  cycle  because  of  changes  in  the  working  memory. 

Advantages  of  production  systems  for  learning  are  the  following: 

Homogeneity  -  all  rules  have  similar  form. 

Independence  -  knowledge  is  broken  up  into  small  modules. 

Stimulus/response  flavor  -  conditions  may  ‘respond’  to  external 
stimuli. 

Goal-driven  behavior  -  conditions  may  be  sensitive  to  goals. 

Parallel  or  serial  in  nature  -  recognize-act  cycle. 

Separable  memories  -  blackboard  and  knowledge  base  are  analogous  to 
short-  and  long-term  memories. 

Rule  preference  can  change  over  time  using  activation  or  strength- 
based  conflict  resolution. 

Modularity  of  knowledge  makes  it  possible  to  learn  by  adding 
productions  in  addition  to  strengthening  productions. 

Variants  can  be  derived  by  generalization  (specific  to  general); 
discrimination  (general  to  specific);  composition  (combining  rules);  and 
proceduralization  (instantiating  rules). 
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THE  PRISM  ARCHITECTURE  BUILDING  TOOL 


PRISM  (Ohlsson  &  Langley,  1986)  provides  the  building  blocks  for  synthesiz¬ 
ing  production  system  languages.  We  use  PRISM  to  formulate  a  system  capable  of 
learning  heuristics  for  controlling  the  parameters  of  sensor  and  communication 
systems. 

PRISM  describes  a  very  comprehensive  space  of  interesting  production  system 
architectures  by  providing  ways  to  specify  the  organization  in  terms  of  components 
(or  schemas),  each  of  which  has  a  small  set  of  associated  parameters.  The  PRISM 
building  blocks  may  be  used  to  define  numerous  well-known  production  systems, 
such  as  OPS4  and  ACTE,  in  addition  to  others  generated  for  individual  research 
projects  or  theses. 

The  developers  of  PRISM  consider  its  major  contribution  to  be  that  it  consti¬ 
tutes  a  framework  for  the  discussion  and  comparison  of  alternative  production  system 
architectures.  For  this  project,  PRISM’s  contributions  were  that  it  facilitated  experi¬ 
mentation  with  architectures  for  learning,  and  it  eliminated  some  of  the  routine 
programming  implementing  new  production  system  languages. 

Except  for  the  rete-network  pattern-matching  process  developed  by  Forgy 
(1979),  which  was  chosen  for  its  efficiency  and  the  overall  structure  of  the  inter¬ 
preter,  nearly  every  aspect  of  the  default  PRISM  architecture  can  be  modified  by 
the  user.  The  rete  pattern  matcher  will  handle  virtually  any  structure.  Notations 
chosen  for  representing  knowledge  are  neither  legislated  nor  enforced  by  the  PRISM 
architecture.  We  can  define  as  many  working  memories  and  procedural  memories 
as  needed,  and  may  create  selection  processes  to  execute  those  productions  (found 
by  the  matching  process  to  be  satisfied)  on  the  basis  of  the  cycle  or  the  order  in 
which  the  element  was  added  to  working  memory,  complexity,  or  activation.  Each 
declarative  memory  can  have  quantitative  attributes  which  we  may  interpret  as 
activation,  strength,  probability,  etc.,  and  which  may  be  initialized,  propagated, 
updated,  accessed,  and  used  differently  for  different  memories.  Different  procedural 
memories  may  be  given  different  selection  schemes  and  be  organized  hierarchically. 

The  flexibility  of  PRISM  allows  productions  in  one  procedural  memory  to  gen¬ 
erate  productions  that  can  be  added  to  another.  In  addition,  all  kinds  of  experimental 
organizations  of  productions  can  be  pursued  simultaneously. 

RULE  STRUCTURING  AND  ORGANIZING 

Metarules  can  be  generated  automatically  to  partition  the  domain  into  man¬ 
ageable  segments.  The  value  of  adding  a  particular  metarule  to  the  rule  collection 
can  be  calculated  by  examining  the  cost  of  evaluating  that  rule  (a  function  of  the 
number  of  conjuncts  in  its  premise)  with  respect  to  the  product  of  the  chance  of 
the  premise  being  evaluated  to  true  and  the  amount  of  pruning  of  the  space  of  rules 
accomplished  by  the  metarule.  These  metarules  could  focus  attention  on  the  seg¬ 
ment  of  the  knowledge  base  having  rules  with  premises  capable  of  evaluating  to 
“true”  given  the  current  facts.  If  a  particular  conjunct  appears  in  many  different  rule 
premises,  evaluating  this  conjunct  first  and  ordering  the  rules  on  the  basis  of  this 


conjunct  could  improve  the  efficiency  of  traversing  the  rule  space.  Metarules  gener¬ 
ated  to  effect  this  ordering  could  take  the  form  of  ruling  in  a  collection  of  rules,  or  of 
ruling  out  some  collection  of  rules,  or  both. 

Metarules  could  distribute  productions  to  different  procedural  memories.  In 
PRISM,  the  rule  space  can  be  partitioned  and  the  resulting  partitions  treated  as  if 
they  were  never  segregated,  or  in  a  whole  panorama  of  different  ways. 

LEARNING  TO  LEARN 

A  metalevel  of  learning  can  be  described  in  which  the  approach  is  to  learn 
heuristics  for  searching  the  rule  space.  The  learning  literature  contains  various  exam¬ 
ples  of  learning  heuristics  to  direct  search  through  problem  spaces.  The  techniques 
used  in  these  learning  systems  can  be  applied  to  the  problem  of  learning  heuristics  to 
direct  search  through  a  space  of  rules.  Thus,  a  system  should  be  able  to  start  with 
veiy  general  and  simple  learning  methods  and  improve  its  ability  to  learn  with  expe¬ 
rience.  All  that  is  needed  is  a  complete  solution  path  to  use  as  the  basis  for  assigning 
credit  and  blame.  Successive  hypotheses  form  a  path  through  the  space  of  rules.  If  the 
techniques  for  generating  the  path  of  hypotheses  can  be  described,  then  we  can  assign 
credit  or  blame  to  those  techniques  which  created  or  learned  the  rules  used  in  the 
performance  system.  Once  these  techniques  are  isolated,  the  approach  can  be  applied 
recursively,  essentially  collapsing  any  rules  for  learning  to  learn  to  learn  into  the  first 
metalevel  of  learning  to  learn.  However,  no  obvious  way  exists  to  represent  powerful 
methods,  such  as  data-driven  generalization  or  discrimination  techniques,  in  terms  of 
modifiable  rules  at  the  metalevel.  For  the  learning  of  learning  heuristics,  it  is  neces¬ 
sary  to  represent  those  techniques  and  all  conceivable  variants  so  that  they  may  be 
“found”  by  the  learner  learning  to  learn. 

However,  in  the  particular  domain  of  radar  parameter  doctrine  learning  there 
may  be  a  way  to  specify  some  of  the  metalevel  learning  principles.  This  is  an  area  for 
future  attention. 
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AI  APPROACHES  TO  LEARNING 

GENERALIZATION 

One  method  for  learning  symbolic  conditions  begins  with  very  specific  infor¬ 
mation  and  generalizes  as  more  data  become  available.  Usually  the  hypothesized 
conditions  are  initialized  to  the  first  positive  instance.  A  new  positive  instance  is 
compared  to  the  current  hypothesis  and  only  those  features  held  in  common  by  the 
instance  and  the  hypothesis  are  retained  in  one  or  more  revised  hypotheses.  If  some 
hypotheses  become  too  general,  incorrect  classifications  occur  and  the  hypotheses  will 
be  discarded. 

As  a  technique,  generalization  refers  to  a  method  for  abstracting  from  the 
details  of  positive  and  negative  examples  to  form  hypotheses  (rules)  which  cover  the 
data.  This  technique  cannot  recover  from  learning  trials  in  which  instances  are 
misclassified,  so  it  is  unsuited  to  noisy  data.  It  also  requires  that  the  concept  to  be 
learned  does  not  change  over  time,  and  that  the  representation  language  is  sufficient 
to  describe  the  concept.  Generalization  has  difficulty  learning  rules  with  disjunctive 
conditions,  since  the  search  is  for  features  held  in  common  by  all  of  the  positive 
instances. 

Descriptions  can  be  made  more  general  by  removing  conditions,  replacing  con¬ 
stants  with  variables,  replacing  a  term  with  another  which  is  its  ancestor  in  a  tree 
expressing  what  are  called  IS-A  hierarchies,  adding  elements  to  lists  of  allowable  ele¬ 
ments,  or  increasing  the  size  of  an  interval  of  allowable  values.  Work  using  generali¬ 
zation  techniques  is  described  by  Winston  (1975),  Vere  (1980),  Mitchell  (1982),  and 
Dietterich  and  Michalski  (1983). 

Generalization-based  approaches  to  learning  are  not  suited  to  the  learning  of 
heuristics  because  they  do  not  provide  sufficient  variety.  In  learning  heuristics,  the 
system  begins  with  extremely  specific  hypotheses  which  are  only  capable  of  very  con¬ 
servative  moves,  so  it  will  begin  by  making  no  bad  moves  and  missing  some  good 
moves.  Where  a  system  must  generate  its  own  instances  of  the  use  of  heuristics,  there 
is  no  great  penalty  for  errors  of  commission,  which  indeed  are  necessary  if  the  system 
is  to  learn,  and  yet  with  the  generalization  method,  very  few  will  be  made.  However, 
the  price  of  omissions  is  great  since  learning  is  impossible  if  the  behavior  which  pro¬ 
vides  the  instances  is  absent.  Generalization  is  most  appropriate  if  there  is  a  benevo¬ 
lent  tutor  to  present  positive  and  negative  examples  which  are  typical  and  which 
cover  the  space  of  the  concept’s  applicability. 

However,  for  heuristics  learning,  analytical  generalization  (in  contrast  to 
simple  generalization)  is  highly  attractive  because  of  its  minimal  need  for  examples. 
Each  case  is  milked  fully  by  attending  to  the  reasons  (causes)  that  make  it  an 
instance  of  the  concept  of  interest.  This  focuses  the  generalization  effort  toward  just 
those  features  which  are  important  to  the  goals  at  hand.  The  literature  contains  pro¬ 
grams  which  are  able  to  learn  new  concepts  on  the  basis  of  just  one  instance.  The 
background  knowledge  of  causal  connections  may  have  to  be  considerable,  however. 
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Analytical  generalization,  which  will  be  discussed  further  below,  would  be 
ideal  as  an  adjunct  to  constructive  techniques  which  can  add  the  variety  missing  in 
simple  generalization  techniques.  Constructive  techniques  free  the  learning  system 
from  the  dangers  of  representations  which  restrict  the  forms  that  can  be  learned 
too  severely.  The  bias  of  the  learning  system  is  flexible  in  systems  with  constructive 
capabilities. 

DISCRIMINATION  LEARNING 

This  learning  technique  starts  from  one  or  more  overly  general  rules  and  gen¬ 
erates  more  specific  versions  through  a  process  of  discrimination.  This  occurs  when 
one  of  the  current  hypotheses  (rules)  leads  to  an  error.  The  context  in  which  the 
faulty  rule  matches  the  negative  instance  is  compared  to  some  context  (usually  the 
last  context)  in  which  that  same  rule  matches  a  positive  instance.  The  comparison 
reveals  differences  between  the  positive  and  negative  instances.  For  each  difference 
found,  a  more  specific  hypothesis  can  be  constructed  (or  strengthened)  which  will 
match  against  the  positive  and  not  the  negative  instance.  The  ability  of  each  hypothe¬ 
sis  to  account  for  the  data  distinguishes  useful  variants  of  hypotheses  from  spurious 
ones. 


Descriptions  can  be  made  less  general  by  adding  conditions,  replacing  vari¬ 
ables  by  constants,  replacing  a  term  with  another  which  is  its  descendant  in  a  tree 
expressing  what  are  called  IS-A  hierarchies,  removing  elements  from  lists  of  allow¬ 
able  elements,  or  decreasing  the  size  of  an  interval  of  allowable  values.  These  are  just 
the  reverse  of  steps  described  above  for  generalization. 

The  discrimination  learning  technique  can  handle  both  relational  and 
attribute-value  representations,  it  can  acquire  rules  containing  complex  negated 
conditions,  it  can  learn  from  far  misses  as  well  as  near  misses,  it  can  learn  in  the 
presence  of  considerable  noise,  and  it  can  learn  rules  which  have  value  heuristically 
in  spite  of  inadequate  representations.  Since  the  discrimination  method  compares 
instances  to  other  instances  rather  than  to  hypotheses  which  summarize  those 
instances,  it  does  not  attempt  to  find  features  common  to  all  positive  instances,  and 
can  easily  learn  rules  with  disjunctive  conditions.  We  use  this  learning  method  in  our 
research.  Other  work  with  the  discrimination  method  includes  ID3  (Quinlan,  1983), 
and  SAGE  (Langley,  1985). 

The  discrimination  method  is  ideal  for  the  learning  of  heuristics  because, 
in  the  move  from  general  to  more  specific  hypotheses,  discrimination  will  not  at 
first  omit  desirable  moves,  although  it  will  consider  many  undesirable  ones  as  well. 
The  performance  will  become  less  rash  as  the  correct  hypothesis  is  approached  dur¬ 
ing  the  discrimination  process.  Only  those  heuristics  which  have  been  proven  to  be 
inappropriate  will  be  removed  from  consideration. 
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THE  VERSION  SPACES  METHOD 

The  version  space  approach  incorporates  aspects  of  both  the  generalization 
and  discrimination  methods  (Mitchell,  1977).  This  approach  begins  with  a  very 
specific  hypothesis  and  generates  more  general  versions  (S)  by  extracting  common 
features  of  the  newly  encountered  positive  instances.  It  simultaneously  begins  with 
a  very  general  hypothesis  and  generates  more  specific  versions  (G)  as  more  data  is 
processed.  However,  instead  of  testing  the  first  set  of  hypotheses  (S)  against  negative 
instances  to  see  if  they  are  overly  general,  it  tests  them  against  the  already  processed 
set  (G).  Similarly,  more  specific  versions  of  the  set  (G)  are  found  by  comparing  nega¬ 
tive  instances  to  the  hypotheses  in  the  processed  set  (S).  As  more  instances  are 
gathered,  this  multidirectional  process  converges  on  the  hypothesis  best  suited  to 
summarize  the  data. 

Unfortunately,  this  method  encounters  almost  all  of  the  disadvantages  of 
the  generalization  approach.  It  searches  for  features  held  in  common  by  all  positive 
instances,  so  it  has  the  same  difficulty  with  disjunctive  rules,  noise,  inadequate  repre¬ 
sentations,  and  concepts  that  change  over  time.  The  only  problem  it  does  not  have  is 
the  introduction  of  variety,  which  is  accomplished  by  the  discrimination  component 
of  the  technique.  We  are  not  currently  employing  this  approach  in  our  research. 

EXPLANATION-BASED  GENERALIZATION 

Explanation-based  generalization,  also  called  learning  by  analytical  generali¬ 
zation,  starts  from  a  goal  concept,  a  training  example,  a  domain,  and  an  operation- 
ality  criterion.  An  operational  description  of  the  goal  concept  that  covers  the 
training  example  needs  to  be  found.  More  precisely, 

goal  concept  =  a  nonoperational  definition  of  the  concept  to  be  learned. 

training  example  =  a  single  positive  instance  of  the  goal  concept. 

domain  theory  =  a  set  of  rules  to  be  used  in  explaining  how  an  entity 
satisfies  the  goal  concept. 

operationality  criterion  =  a  test  specifying  the  form  of  the  definition  to  be 

learned. 

The  process  consists  of  two  steps,  explanation  and  characterization.  The  expla¬ 
nation  is  constructed  using  the  domain  theory  to  prove  that  the  training  example  is  a 
positive  instance  of  the  goal  concept.  All  the  nodes  of  the  explanation  tree  produced 
by  this  process  must  be  operational.  The  characterization  is  constructed  by  determin¬ 
ing  a  set  of  sufficient  conditions  under  which  this  explanation  holds,  stated  in  opera¬ 
tional  terms.  The  goal  concept  may  be  regressed  through  the  explanation  tree  to 
accomplish  this. 
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This  analytic  approach  to  learning'  has  various  advantages.  It  does  not  require 
extensive  search  through  the  space  of  concept  descriptions  or  rules,  since  the  explana¬ 
tion  leads  directly  to  the  learned  description.  It  handles  disjunctive  concepts,  since  it 
finds  only  sufficient  (rather  than  necessary)  conditions  on  the  concept.  It  can  learn 
from  a  single  positive  training  instance;  negative  instances  are  not  required.  It  can 
handle  noisy  data,  since  the  explanation  process  will  catch  misclassified  instances. 
Finally,  it  provides  a  justification  for  the  characterization  of  the  concept  description 
which  is  based  in  the  operationality  criterion  and  the  explanation. 

There  are  also  some  disadvantages  to  the  analytic  approach  based  on  explana¬ 
tion.  It  lacks  generality  since  it  must  be  grounded  in  a  rich  enough  framework  of 
domain  knowledge  to  form  the  explanations.  The  search  that  is  saved  in  the  space  of 
concept  descriptions  is  required  in  the  space  of  explanations.  Where  multiple  explana¬ 
tions  are  appropriate,  search  through  the  space  of  concept  descriptions  may  still  be 
necessary. 

Within  the  domain  of  radar  parameter  control,  there  is  a  body  of  analytic 
relationships  which  may  lend  themselves  to  exploitation  through  explanation-based 
learning.  This  is  an  area  for  future  attention.  Researchers  in  this  area  include 
Mitchell,  Keller,  and  Kedar-Cabelli  (1986),  and  DeJong  and  Mooney  (1986). 

LEARNING  AS  SEARCH 

Search  plays  an  important  role  in  machine  learning,  as  it  does  in  the  rest 
of  artifical  intelligence.  In  machine  learning,  search  occurs  in  the  space  of  rules 
or  hypotheses  rather  than  just  through  the  space  of  simple  problem  states.  Most 
machine  learning  systems  use  rather  straightforward  search  methods  (such  as  depth- 
first  or  breadth-first  search),  and  search  through  the  space  of  hypotheses  often  takes 
advantage  of  its  partial  ordering  on  the  basis  of  the  generality  of  the  hypotheses. 
However,  the  operators  for  search  may  themselves  involve  search,  and  are  generally 
more  powerful  than  operators  found  in  other  problems  for  which  AI  approaches  are 
used.  The  direction  of  search  we  saw  could  be  from  specific  to  general,  as  in  generali¬ 
zation,  or  general  to  specific,  as  in  discrimination,  or  both,  as  in  the  version  spaces 
method. 

Search  always  occurs  in  some  problem  space,  and  can  be  constrained  in  a  vari¬ 
ety  of  ways.  The  constraints  on  search  in  the  context  of  machine  learning  are  called 
the  bias  of  the  learning  system.  Bias  can  be  attributable  to  the  representation  or  to 
the  search  organization.  Representational  bias  results  from  considering  only  certain 
features  of  the  instances  (only  those  expressed  in  the  system),  or  from  allowing  only 
certain  forms  of  hypotheses.  Many  learning  systems  are  restricted  to  learning  only 
hypotheses  which  can  be  expressed  as  conjuncts,  for  example. 

Search  bias  occurs  when  hypotheses  that  violate  certain  constraints  are  eli¬ 
minated  from  consideration.  For  example,  many  systems  will  reject  any  hypotheses 
which  are  inconsistent  with  the  data,  thereby  making  them  sensitive  to  noise.  Order¬ 
ing  hypotheses  by  some  criterion  also  constitutes  a  bias.  In  Appendix  B,  we  list  the 
preference  criteria  considered  for  inclusion  in  our  learning  system.  All  learning 
systems  must  have  biases  or  no  learning  could  take  place.  Methods  for  shifting  or 
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weakening  inappropriate  biases  may  include  changing  the  characteristics  of  the  lan¬ 
guage  in  which  hypotheses  and  data  are  described,  altering  the  space  of  hypotheses 
which  may  be  considered,  varying  the  procedures  which  define  the  order  in  which 
hypotheses  are  considered  or  valued,  and  changing  the  acceptance  criteria  for  deter¬ 
mining  when  a  search  procedure  has  found  a  “good  enough”  candidate  hypothesis. 

Strong  bias  is  one  that  focuses  the  learner  on  relatively  few  hypotheses.  An 
incorrect  bias  is  one  which  prevents  the  learner  from  discovering  the  correct  hypothe¬ 
sis.  Paul  Utgoff  (Utgoff  1984)  addresses  the  problem  of  altering  incorrect  or  weak 
biases  to  improve  learning  abilities. 

CONCEPTUAL  CLUSTERING 

Conceptual  clustering  is  an  outgrowth  of  the  older  data-analysis  methods  of 
cluster  analysis  and  numerical  taxonomy  in  which  the  task  is  to  find  a  hierarchical 
classification  tree  that  summarizes  data  given  in  the  form  of  attribute-value  repre¬ 
sentations  of  a  set  of  objects.  The  intent  is  to  maximize  intracluster  similarity  while 
minimizing  intercluster  similarity.  Distance  in  N-space  is  commonly  used  to  measure 
similarity.  However,  only  the  objects  themselves  are  used  to  evaluate  the  clusterings 
and,  in  the  worst  cases,  the  results  can  be  uninterpretable. 

Michalski  and  Stepp  (1983)  have  formulated  the  task  of  conceptual  clustering 
which,  in  addition  to  generating  the  hierarchy,  demands  that  intensional  descrip¬ 
tions  of  the  resulting  clusters  be  produced.  The  quality  of  those  descriptions  figure  in 
the  evaluation  of  the  clusters.  The  resulting  clusters  are  more  conceptually  coherent 
than  those  generated  by  traditional  methods. 

In  numerical  taxonomy  approaches,  objects  are  represented  as  points  in  an 
N-dimensional  space.  The  method  typically  proceeds  by  creating  a  cluster  from  the 
two  closest  objects  in  the  space,  removing  them  and  creating  a  new  object  whose 
coordinates  are  the  average  of  its  members’  coordinates,  continuing  until  all  objects 
are  included  in  a  single  cluster. 

In  contrast,  CLUSTER/2  (Michalski  &  Stepp,  1983)  employs  generalization  to 
cover  all  the  objects  from  an  initial  selection  of  N  seed  objects,  using  them  to  simu¬ 
late  positive  and  negative  instances.  Once  the  set  of  objects  is  clustered  on  the  first 
round,  a  new  set  of  N  seed  objects  which  constitute  the  central  tendency  of  the  result¬ 
ing  clusters  is  chosen,  and  the  process  of  generalizing  to  cover  the  remaining  objects 
is  repeated,  until  the  system  stabilizes  on  a  particular  set  of  seeds.  Finally,  each  of 
the  clustered  sets  of  objects  is  characterized,  producing  a  description  for  each  cluster. 
The  entire  method  is  repeated  for  different  numbers  of  seed  objects  (where  N  ranges 
from  2  to  about  7),  and  the  best  clustering,  according  to  the  criteria  forjudging  the 
descriptions,  is  used  to  add  branches  to  the  tree  which  will  embody  the  classification. 
The  process  is  then  applied  recursively  (and  separately)  to  each  of  the  resulting 
clusters  until  no  additional  progress  is  made  by  further  subdivisions. 
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A  simpler  conceptual  clustering  system,  RUMMAGE  (Fisher,  1984),  is  model 
driven  and  uses  knowledge  of  attributes  to  divide  objects  into  groups.  The  attribute 
that  divides  the  objects  so  that  their  resulting  characterizations  are  the  best  is  used 
to  form  the  branches  of  the  tree  at  each  point. 

Conceptual  clustering  involves  three  levels  of  search,  the  search  for  clusters 
of  objects,  the  search  for  characterizations  of  clusters,  and  the  search  for  hierarchies 
of  the  clusters.  Our  clustering  program  uses  a  model-driven  approach  to  find  the 
clusters  of  objects  and,  like  RUMMAGE,  uses  the  attributes  individually  to  specify 
branches  at  each  point  in  the  hierarchy.  However,  it  is  simpler  than  RUMMAGE 
since  it  uses  as  its  criteria  of  quality  the  aim  of  minimizing  the  total  number  of 
nodes  in  the  tree.  This  is  not  an  exact  match  to  value  for  a  classification  tree,  since 
number  of  nodes  is  not  coextensive  with  ease  of  access,  or  even  with  minimum 
number  of  tests  to  make  a  decision  using  the  tree.  However,  it  does  provide  an  initial 
cut  for  clustering  objects  in  a  new  domain.  Additional  work  on  conceptual  clustering 
is  described  by  Fisher  and  Langley  (1985  and  1986),  and  an  incremental  conceptual 
clustering  is  introduced  in  COBWEB  (Fisher,  1986). 

CHUNKING 

Chunks  were  originally  proposed  to  explain  short-term  memory  phenomena 
(Miller,  1956).  The  term  “chunk”  refers  to  a  familiar  pattern  that  can  be  easily 
remembered  and  manipulated  as  a  single  entity.  Chunks  figure  in  cognitive  psychol¬ 
ogy  to  account  for  the  differences  between  novices  and  experts.  They  may  be  either 
perceptual  in  nature  or  action-oriented  and  can  involve  either  spatial  or  sequential 
action  structures.  Most  of  the  chunks  appearing  in  AI  involve  sequential  action 
structures. 

In  SOAR  (Laird,  Rosenbloom,  and  Newell,  1986),  an  architecture  has  been 
built  for  problem  solving  and  learning  by  chunking.  In  the  context  of  a  means-ends 
analysis  framework,  the  architecture  creates  subgoals  as  difficulties  are  encountered. 
The  subgoal  then  creates  a  chunk  stated  as  a  production  rule  which  allows  it  to 
bypass  the  need  to  generate  and  achieve  that  subgoal  in  the  future. 

The  rule  created  by  SOAR  includes  in  the  conditions  for  the  rule  all  memory 
elements  that  were  present  when  the  subgoal  was  created  which  were  subsequently 
matched  during  the  processing  of  that  subgoal.  It  includes  on  the  action  side  of  the 
rule  all  memory  elements  constructed  during  the  processing  of  the  subgoal  which  can 
be  reached  from  the  subgoal  by  chaining  through  links.  All  nonterminal  symbols  are 
replaced  by  variables,  resulting  in  the  formation  of  relatively  general  rules.  SOAR 
does  not  search  through  a  space  of  possible  rules.  The  problem  solving  progress 
determines  what  rules  are  learned;  learning  is  one-trial  and  automatic. 

Chunking  in  SOAR  leads  to  different  effects  depending  on  what  difficulty  is 
resolved  by  the  subgoal.  When  the  subgoal  is  to  determine  what  operator  to  apply, 
SOAR  learns  heuristics;  when  the  subgoal  is  to  determine  which  state  to  select, 
SOAR  learns  an  evaluation  function  on  the  states;  and  when  the  subgoal  is  to  apply  a 
complex  operator,  SOAR  learns  macro-operators  represented  as  a  set  of  rules.  Differ¬ 
ent  forms  of  learning  in  SOAR  arise  not  from  different  learning  mechanisms,  but 
from  variety  in  the  problem  solving  process. 
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MACRO-OPERATORS 


Machine-learning  researchers  have  explored  two  approaches  to  improving 
problem  solving  performance:  learning  heuristic  conditions  on  operators  to  constrain 
the  search  process,  and  defining  higher-  level  operators  which  shortcut  the  steps 
needed  to  traverse  the  problem  space.  The  latter  approach  is  called  learning  macro¬ 
operators.  Such  “macros”  can  be  represented  either  as  a  single  data  structure  in 
which  a  list  of  operators  is  specified,  or  as  conditions  on  independent  operators  which 
cause  them  to  be  applied  in  a  certain  order. 

Problems  which  do  not  have  nearly  decomposable  subgoals  require  the  prob¬ 
lem  solver  to  temporarily  violate  goals  which  were  achieved  earlier.  Macros  can  be 
formed  for  some  of  these  processes  to  allow  the  problem  to  be  tackled  in  a  new  prob¬ 
lem  space  in  which  intermediate  steps  can  be  ignored.  For  problems  expressible  in 
terms  of  evaluation  functions,  macros  can  be  seen  as  bypassing  local  valleys  (or 
peaks)  in  order  to  achieve  a  solution  or  a  more  robust  solution.  This  approach  to 
learning  is  used  and  described  by  Neves  and  Anderson  (1981),  Korf  (1982),  Iba  (1985), 
and  Anderson  (1983,  1986). 

HEURISTICS  LEARNING 

The  task  of  learning  search  heuristics  can  be  formalized  as  follows:  GIVEN:  i 

(1)  an  initial  state  from  which  to  begin  the  search  (for  one  or  more  problems);  (2)  a 
set  of  operators  for  generating  new  states  along  with  their  legal  conditions  for  appli-  i 

cation;  (3)  a  test  to  determine  if  the  goal  has  been  reached;  and  (4)  a  search  strategy 
for  selecting  operators  and  states,  FIND:  Heuristic  conditions  for  each  operator 
which  will  reduce  or  eliminate  search. 

Methods  for  strategy  learning  can  lead  to  improvement  in  which  search  is 
reduced  on  practice  problems  during  their  solution,  or  several  varieties  of  transfer  in 
which  search  is  reduced  on  new  problems.  The  transfer  may  be  to  scaled-up  prob¬ 
lems,  to  problems  with  different  initial  and  goal  states  of  the  same  complexity,  or  to 
problems  also  of  the  same  complexity  but  with  a  differently  structured  state  space  for 
which  learning  by  analogy  (Carbonell,  1986)  may  be  appropriate. 

Learning  heuristics  has  been  accomplished  by  learning  from  solution  paths 
(Langley,  1985).  Once  a  solution  path  is  found,  credit  and  blame  can  be  assigned  to 
instances  of  the  application  of  rules.  Each  move  along  the  solution  path  can  be 
marked  as  a  positive  instance  of  the  rule  that  proposed  it,  and  each  move  one  step  off 
of  the  path  can  be  marked  as  a  negative  instance  of  y  rule  that  proposed  it.  The 
positive  and  negative  instances  can  then  be  passed  to  some  characterization  method 
to  determine  the  heuristic  conditions  on  each  move-proposing  rule. 

I 

Where  it  is  not  feasible  to  wait  for  a  solution  to  begin  the  process  of  learning 
heuristics  to  constrain  search,  moves  can  be  classified  as  undesirable  during  the 
search  for  solutions  by  noting  loops,  flagging  dead  ends,  detecting  illegal  states  or 
moves,  noting  failure  to  progress  towards  a  goal,  or  detecting  less  redundant  or 
shorter  paths,  as  in  the  Universal  Puzzle  Learner  (UPL)  system  (Ohlsson,  1983). 

Moves  can  also  be  classified  as  desirable  if  shorter  and  less  redundant  paths  are 
recognized,  or  identifiable  progress  towards  goals  is  noted. 


19 


LEARNING  EVALUATION  FUNCTIONS 


A  method  for  selecting  states  for  further  expansion  during  problem  solving 
involves  the  construction  of  a  numerical  evaluation  function  to  rank  the  states  and, 
thereby,  control  search.  A  checker-playing  program  (Samuel,  1959)  chooses  moves  on 
the  basis  of  a  linear  evaluation  function.  The  system  experimentally  introduced  new 
terms  from  a  set  of  predefined  features,  adjusted  the  weights  of  existing  terms,  and 
took  note  of  the  resulting  effect  on  its  playing  ability. 

In  domains  with  numerical  attributes,  curve-fitting  techniques  can  be  used  to 
generate  functions  which  predict  known  ratings  of  states  in  terms  of  sets  of  prede¬ 
fined  features,  and  the  resulting  functions  can  subsequently  be  used  for  directing  the 
search  process.  Although  these  techniques  can  be  valuable  for  domains  rich  in  con¬ 
tinuous  attributes,  they  are  not  very  well  suited  to  acquire  heuristics  which  can  only 
be  stated  in  symbolic  terms.  Such  symbolic  variables  could  be  translated  into  a  set  of 
dichotomies  which  have  either  zero  or  one  as  possible  values,  but  some  information  is 
lost  pertaining  to  the  constraints  between  specific  values  of  the  original  nominal  vari¬ 
able,  and  the  evaluation  function  may  end  up  being  rather  awkward  to  construct. 

THE  COMPOSITION  MECHANISM 

Composition  operates  by  collapsing  multiple  productions  into  a  single  produc¬ 
tion  which  has  the  effect  of  executing  the  set  of  productions.  For  the  productions  to 
be  collapsible,  they  must  not  contain  actions  which  consist  of  arbitrary  Lisp  func¬ 
tions,  that  is,  their  actions  sides  must  be  transparent.  Actions  which  delete  or  remove 
elements  can  also  cause  difficulty,  as  can  negated  conditions.  In  early  research  it  was 
assumed  that  composition  should  occur  whenever  two  rules  were  applied  in  sequence, 
but  Anderson  (1983)  evokes  composition  only  when  goals  are  achieved. 

PROCEDURALIZATION 

Proceduralization  builds  into  the  productions  information  which  formerly  had 
to  be  retrieved  from  long-term  memory.  This  process  forms  more  specific  variants  of 
rules  which  are  used  so  that  in  subsequent  accesses  of  those  specific  variants  of  the 
rule,  the  domain-specific  information  retrieval  step  is  bypassed  and  the  match  proc¬ 
ess  finds  all  of  the  necessary  information  in  the  interpretive  production  which  was 
constructed.  In  ACT  (Anderson,  1983),  the  combination  of  composition  and  procedur¬ 
alization  has  resulted  in  a  robust  learning  system.  Recently,  Anderson  (1986)  has 
attempted  to  explain  how  generalization  and  discrimination  effects  can  emerge  from 
this  combination. 

GENETIC  ALGORITHMS 

Genetic  algorithms  are  search  algorithms  based  on  the  mechanics  of  natural 
genetics.  To  apply  genetic  algorithms  to  the  task  of  learning,  John  Holland  (1986)  of 
the  University  of  Michigan  constructed  a  system  consisting  of  three  main  elements: 

(1)  a  rule  and  message  system,  (2)  an  apportionment  of  credit  system;  and  (3)  a 
genetic  algorithm. 
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Starting  from  a  randomly  generated  state,  the  learning  system  learns  string- 
rules  called  classifiers  which  match  strings  called  messages.  Messages  derive  either 
from  previously  activated  classifiers  or  from  environmental  sensors.  The  effectiveness 
of  each  classifier  is  evaluated,  and  new  rules  (classifiers)  are  created  using  the  inno¬ 
vative  search  mechanism  of  the  genetic  algorithm.  The  classifiers  are  then  used  to 
guide  the  system’s  behavior  in  the  environment.  The  environment  impinges  on  the 
system  through  its  sensors,  called  detectors.  This  information  is  decoded  to  some 
standard  message  format  and  the  result  is  placed  on  a  message  list  along  with  the 
rest  of  the  messages  generated  by  the  previous  cycle.  Messages  on  the  message  list 
may  activate  classifiers,  rules  in  the  classifier  store.  Activated  rules  may  send  mes¬ 
sages  to  the  message  list  for  the  next  cycle.  In  addition,  certain  messages  may  call  for 
external  action  through  a  number  of  action  triggers  called  effectors.  Thus,  both  inter¬ 
nal  and  external  data  are  used  through  the  message  system  to  guide  behavior  and  the 
state  of  the  system  for  the  next  cycle. 

The  relative  value  of  candidate  rules  is  determined  by  the  simulation  of  a 
competitive  service  economy.  The  right  to  respond  to  relevant  messages  is  given  to 
the  classifier  with  the  highest  “bid”.  The  payment  of  the  “bid”  is  made  to  the  classifi¬ 
er  which  previously  sent  the  message,  the  successful  message  sender.  In  this  way,  a 
chain  of  middlemen  is  formed  from  “manufacturer”  (source  message)  to  message  “con¬ 
sumer”  (environmental  action  and  payoff).  The  competitive  nature  of  the  economy 
insures  that  the  good  rules  survive  and  the  less  valuable  ones  die  off. 

Messages  and  classifiers  have  a  very  simple  representation  in  terms  of 
binary  strings  with  a  wildcard  “#”  value  which  matches  either  a  “0”  or  a  “1”.  Thus 
the  alphabet  consists  of  {0,1,#}.  String  rules  expressed  in  this  form  play  the  role  of 
chromosomes  and  provide  the  raw  material  for  the  generation  of  new  string  rules 
constructed  from  a  structured,  yet  randomized,  exchange  of  information  among 
randomly  mated  pairs  of  rules. 

A  genetic  algorithms  approach  can  be  applied  to  learning  optimum  parameter 
settings  for  sensor  and  communication  systems  and  is,  in  fact,  the  approach  used  in  a 
battle  management  systems  control  rule  optimization  project  at  the  Naval  Surface 
Weapons  Center  in  Dahlgren,  VA  (Kuchinski,  1985). 

We  reserved  this  approach  for  examination  last,  if  expected  progress  did  not 
materialize  from  other  approaches.  We  were  reluctant  to  use  it,  not  because  it  was 
inapplicable  to  the  domain,  but  because  results  from  our  other  learning  research 
could  contribute  to  cognitive  theories  of  learning. 

NEURAL  MODELING  AND  CONNECTIONIST  APPROACHES 

Neural  modeling  and  connectionist  approaches  to  learning  in  complex  domains 
are  very  attractive  since  they  do  not  require  the  kinds  of  preliminary  analysis  of  the 
domain  necessary  for  other  approaches.  In  this  framework,  knowledge  is  typically 
represented  in  terms  of  weights  on  the  links  in  a  ‘neural  network’.  Learning  takes 
place  by  making  modifications  to  those  weights.  The  approach  makes  very  few 
assumptions  and,  although  it  operates  more  slowly  than  other  methods,  is  more 
general.  Speedup  may  occur  since  it  has  a  straightforward  adaptation  to  parallel 
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implementation.  Indeed  another  name  for  these  systems  is  parallel  distributed  proc¬ 
essing  (PDP)  systems.  In  these  systems,  the  representation  and  processing  structure 
are  identical.  Multiple  representations  are  linked  by  local  cooperation  and  competi¬ 
tion.  Learning  and  adaptability  are  fundamental  primitives,  and  handling  multiple 
goals,  multiple  constraints,  and  conflicts  is  fundamental  to  the  system. 

These  systems  are  extremely  powerful  and  robust  both  for  computations  and 
for  representations.  They  are  fault  tolerant,  and  degrade  gracefully  at  the  peripheries 
of  their  areas  of  competence.  Solutions  that  meet  the  formal  constraints  on  a  solution 
can  be  reached  quickly,  and  solutions  can  be  based  on  incomplete,  ambiguous,  error¬ 
ful,  and  even  contradictory  data  in  both  facts  and  goals.  Knowledge  is  distributed 
across  processing  elements,  yet  rule-governed  behavior  emerges  in  the  absence  of 
rules.  The  starting  state,  plus  goal  conditions,  transform  the  system  into  the  end 
state. 


However,  the  end  product  of  the  learner  is  a  system  capable  of  generating 
the  desired  behavior,  not  a  set  of  rules  or  an  explicit  representation  of  what  has  been 
learned.  Thus,  if  we  used  this  approach  to  learning  control  doctrine  for  sensor  and 
communication  systems,  we  would  have  a  system  which,  in  some  sense,  learned  the 
doctrine,  but  we  would  have  no  way  of  knowing  what  that  doctrine  was  except  by 
watching  it  being  ‘applied’  by  the  system  during  operation.  Consequently,  for  our 
research,  this  approach  was  tabled. 

Recent  work  in  connectionist  models  of  learning  have  been  carried  out  by 
Anderson  and  Hinton  (1981),  Kohonen,  Oja,  and  Lehtio  (1981),  Barto  (1985)  with 
his  self-interested  model,  Rumelhart,  Hinton,  and  Williams  (1985)  with  their  general¬ 
ized  delta  rule,  Fukushima  (1982)  with  his  “neocognitron,”  and  Hampson  and  Volper 
(1986).  More  needs  to  be  done  to  improve  the  learning  rate  before  the  connectionist 
framework  will  be  applied  routinely  to  complex  problems.  Steve  Hampson  of  the 
University  of  California,  Irvine  has  recently  employed  conditional  probabilites  to  cut 
the  learning  rate  by  possibly  a  factor  of  200  or  more. 

OTHER  APPROACHES  TO  LEARNING 

This  report  does  not  discuss  classical  estimation  and  control,  supervised  and 
unsupervised  Bayesian  learning  theory,  learning  logics  (nonmonotonic  and  inductive 
logics),  pattern  recognition,  search  theory,  and  optimization  techniques.  These  prom¬ 
ising  areas  of  research  were  not  included  because  our  investigations  were  already  so 
broad. 


A  RADAR  EXAMPLE 


The  radar  situation  used  as  an  example  in  this  report  is  a  simplification  of  the 
general  problem  described  in  Dillard  (1986).  The  concepts  involved  and  the  descrip¬ 
tion  of  a  two-dimensional  air  radar  case  are  listed  below. 

THE  GENERAL  PROBLEM 

Environment 

Track  data  (dymnamics,  cross  sections,  ID’s...) 

Intelligence 

Electronic  countermeasures  (ECM) 

Reaction  times 
Terrain,  Weather 

Possible  Variable  Parameters 

Next  pointing  angle(s) 

Angular  coverage  (1  pencil  beam,  1  fan  beam,  n  simultaneous  beam,  or 
a  combination) 

Per  Beam 

PRF  (pulse  repetition  frequency) 

Dwell  time 
Waveform/resolution 
Frequency 
Power 

Number  of  looks  per  scan 
Per-Beam  Target  Situations  (One  or  more) 

Default 

No  track  is  likely  to  continue  in  that  beam  on  that  scan,  and 
there  are  no  indications  from  intelligence  or  electronic  support 
measures  (ESM)  that  a  target  is  likely  to  enter  from  that 
direction. 
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Track  continuation 


A  current  track  could  continue  in  or  enter  that  beam. 

High  speed 

A  target  that  could  be  in  that  beam  is  travelling  at  high  speed. 

Weak 

Either  small  size  or  great  distance  is  making  the  target  that 
could  be  in  that  beam  have  a  weak  signal  strength. 

Close  range 

The  target  is  likely  to  be  too  close  for  the  use  of  a  high 
resolution  pulse. 

Priority  search 

Intelligence,  ESM,  or  other  sensors  have  indicated  a  target 
might  be  entering  from  that  direction  any  time. 

Two  in  one  bin 

There  is  a  likelihood  of  at  least  two  targets  in  the  same  range 
bin  in  a  given  beam. 

A  TWO-DIMENSIONAL  AIR  RADAR  EXAMPLE 
Radar  Description 

Agile  fan  beam,  10-degree  beamwidth 
162-nmi  instrumented  range 
300  pulses  per  second 
Pulse  duration  =  100  ns  (low  resolution) 
or  2  ns  (high  resolution) 

Dwell  time  per  beam  =  0.1  second  (30  pulses) 

or  0.2  second  (60  pulses) 

Looks  (beams)  per  beam  position  per  scan  =  1  or  2 
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Example  of  a  parameter  setting  rule 


(Situation  Conditions  -  >  Parameter  Setting) 

Situation  Conditions 

Low-density  target  environment 
For  the  beam  in  question: 

Priority  Search 
Not  a  track  continuation 
Expected  target  is  not  high  speed 
Parameter  Setting 

Dwell  time  =  0.2  sec 
Number  of  looks  (per  scan)  =  2 
SIMPLIFICATIONS 

Initially  limit  environmental  considerations  to  track  data  and  to  warnings  of 
potential  targets. 

Limit  per-beam  situations  to  just  three  categories: 

Default 
High  speed 

Other  (All  others  are  included  here). 

Assume  all  targets  are  radial,  i.e.,  they  remain  in  the  same  beam  position. 
Limit  per-beam  parameters  to 

Dwell  time,  with  a  choice  of  0.1,  0.15  (an  addition  to  the  above 
example),  or  0.2  second, 

Looks  per  scan,  with  a  choice  of  1  or  2  looks. 

(Omit  considerations  of  low-  vs  high-resolution  pulse  duration.) 
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Consider  four  target  types 

High-speed  (1000  knots)  weak  targets  [to  be  called  Target_W] 

High-speed  (1000  knots)  average-strength  targets  [to  be  called 
Target_X] 

Average-speed  (400  knots)  weak  targets  [to  be  called  Target_Y] 

Average-speed  (400  knots)  average-strength  targets  [to  be  called 
Target_Z] 

(The  term  “weak”  may  be  interpreted  as  conflating  average-size  targets 
at  maximum  range  and  small  targets  at  midrange.) 

Performance  measures 

False-alarm-rate  units 

Target-acquisition  units  for  each  of  the  four  types  of  targets  above. 
Track  quality  units  again  for  each  of  the  four  types  of  targets  above. 

Omit  consideration  of 

Average-expended  energy 
Target  resolution 
Blind  range 

Limit  attention  to  Task  A  in  which  the  goal  is  to  learn  the  principles  of 
assigning  values  to  the  parameters,  given  the  situation. 

NOTATION 

Appendix  A  describes  this  simplified  problem  in  considerable  detail.  It 
includes  examples  of  the  situation  space,  parameter  selection  strategies,  the 
parameter  space,  and  component  performance  measures.  A  summary  of  the 
notation  used  is  given  below. 

Let  na,  nb,  and  nc  denote  the  number  of  beam  positions  believed  to  have 
situation  a  (default),  situation  b  (high  speed)  and  situation  c  (other),  respectively. 

Let  al,  bl,  and  cl  denote  the  looks  per  scan  to  be  used  (next  scan)  in  beams 
having  situations  a,  b,  and  c,  respectively. 

Let  a2,  b2,  and  c2  denote  the  dwell  time  to  be  used  (next  scan)  in  beams 
having  situations  a,  b,  and  c,  respectively. 

The  simplest  strategy  calls  for  values  of  al,  a2,  bl,  b2,  cl,  and  c2  to  be 
selected  for  the  next  scan  based  on  the  current  situation  (na,  nb,  nc). 
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THE  RULE  LEARNING  PROCESS 
Sample  Rules  from  the  Performance  Set 

Most  specific 

If  High-Speed  &  na  =  35  &  nb  =  1 
then  bl  =  2  &  b2  =  0.2. 

If  Default  &  na  =  35  &  nb  =  1 
then  a2  =  0.1. 

More  general  rules  may  also  be  added. 

If  High-Speed  &  na  >  30 

then  bl  =  2  &  b2  =  0.2. 

As  long  as  we  start  with  a  set  of  rules  which  spans  the  space  of  possible 
scenarios,  we  can  start  the  learning  process. 

Input  to  the  Learner: 

At  least  two  cases  with  associated  details  on 
environment 
sensor  capabilities 
parameters  chosen 

performance  measures  for  that  choice. 

[History  file  of  previous  cases] 

[Analytical  relationships  between  variables  for  use  in  Explanation-Based 
Learning  techniques] 

Output  from  the  learner: 

Possibly  -  changes  in  weights  associated  with  rules  in  the 
performance  set 

-  additional  rules  to  enter  into  the  performance  set 
[removal  of  rules  from  the  performance  set] 
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Note: 


Removal  of  rules  is  not  necessary  from  the  point  of  view  of 
improving  the  performance  of  the  parameters  chosen,  since 
weights  may  be  set  so  that  a  given  no-longer-useful  rule 
will  not  be  used,  but  removal  may  be  desirable  to  improve 
the  efficiency  with  which  rules  are  selected  for  execution 
during  processing. 

Allows  incremental  learning: 

Any  new  case  may  be  compared  with  all  previous  cases  for  modifying  the 
performance  rule  set. 
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EXPERIMENTS 


Initially,  a  conceptual  clustering  program  was  written  to  address  the  learning 
tasks  of  determining  intermediate  features  of  situations  and  parameters  (Tasks  C  and 
D).  This  program  uses  a  model-driven  method  for  constructing  nodes  and  minimizes 
the  number  of  nodes  in  the  clustering  tree.  It  assumes  that  the  variables  provided  for 
describing  the  situations  and  parameters  are  relevant  to  the  task  of  choosing  appro¬ 
priate  parameters. 

The  PRISM  production-system  architecture  builder  was  used  to  construct  an 
initial  experimental  performance  production  system  for  a  two-dimensional  agile-beam 
radar.  This  system  proposes  parameter  settings  given  the  situation  and  environment. 
Its  behavior  was  to  provide  feedback  to  the  learning  system  to  begin  the  process  of 
learning  optimum  choices.  However,  the  performance  system  was  built  using  an 
excessively  complex  model,  and  there  was  no  assurance  that  the  initial  rules  spanned 
the  space  of  possible  scenarios.  Simplifications  in  the  initial  model  warranted  recon¬ 
struction  of  the  performance  system  that  was  incorporated  into  this  learning  system. 
The  pieces  of  the  system  responsible  for  performance  can  be  isolated  easily  because 
they  form  separate  production  memories.  The  advantage  of  this  integration  with  the 
learning  system  is  that  learned  productions  may  be  immediately  put  to  use  in  solving 
problems. 

The  PRISM  architecture  builder  was  reimplemented  to  make  it  compatible 
with  the  LOOPS  object-oriented  language  on  the  Xerox  1108.  The  intent  was  to 
make  it  possible  fo-  information  housed  in  LOOPS  hierarchies  to  be  accessed  by 
learning  systems  built  using  the  PRISM  architecture  builder.  However,  making  the 
two  systems  compatible  resulted  in  a  more  complex  syntax  for  PRISM.  Additional 
familiarity  with  PRISM  revealed  that  the  advantages  of  hierarchical  storage  could  be 
obtained  within  PRISM.  Even  for  systems  already  implemented  in  LOOPS,  transfer 
of  all  the  material  into  linked  PRISM  declarative  memories  would  be  superior  to  los¬ 
ing  PRISM’s  flexibility  of  associating  numerical  attributes  to  the  elements  in  its 
memories  for  use  in  selection  processes. 

Details  for  a  PRISM-based  production  system  learner  were  worked  out.  This 
system  consists  of  a  set  of  rules  for  adding,  modifying,  and  weighting  rules  in  the 
performance  system.  Defining  separate  production  memories  in  PRISM  allows  us  to 
store  performance  productions  in  the  best  manner  for  functioning  to  set  parameters, 
while  storing  learning  productions  in  the  best  manner  for  learning. 

The  first  step  in  our  learning  approach  (to  the  agile-radar  problem)  was  to 
investigate  clustering,  based  on  Task  A.  What  follows  is  a  description  of  a  way  of 
implementing  this  approach.  Figure  2  gives  the  context  in  which  experiments  were 
made. 


Figure  2.  Interaction  of  modules. 

Terminolgy  used  in  Figure  2  is  as  follows: 

1  Trial:  PFA  value,  (na  nb  nc)  values,  parameter  selection 

Parameter  selection  for  simple  strategy:  (a2  bl  b2  cl  c2)  values 

formula  1:  FAR_units  =  120  *  exp(2  *  ((log  FAR)  -  2.1)) 

formula2:  <  >_units  =  170  *  exp(-3. 52636  *  detections_per_cell) 

if  detections_per_cell  >  1,  or 

=  8.55  *  exp(-0.5365  *  detections_per_cell) 
otherwise. 

<  >  =  targ  W  acquis,  targ  X  acquis,  targ  Y_acquis,  targ_Z_acquis, 
track_W_qual,  track_X]]qual,  track_Y_qual,  track_Z_qual 


EXAMPLE:  CLUSTERING,  TASK  A 


-  for  simple  strategy:  (na  nb  nc  — >  al  a2  bl  b2  cl  c2) 

Before  beginning  experiments,  the  following  procedure  was  devised: 

(1)  Start  with  an  “average"  situation,  e.g.,  na  =  28,  nb  =  3,  nc 
=  5. 

(2)  Select  4  parameter  combinations  for  initial  sampling,  e.g., 
select  some  having  the  specified  characteristics: 

si:  All  or  most  parameters  maximized; 

s2:  All  or  most  parameters  minimized; 

s3:  Mixture  of  large  and  small;  and 

s4:  Mixture  of  large  and  small,  differing  in  at  least  two 
parameters. 

(3)  Form  all  possible  pairs  of  samples  (parameter  combinations 
and  performance):  (si  s2),  (si  s3),  (si  s4),  (s2  s3),  (s2  s4),  (s3 
s4). 

(4)  Divide  these  into  4  classes  (permute  pair  if  needed): 

(unsat,  unsat)  —  unsatisfactory  if  a  measure  exceeds  its 
limit 

(sat,  unsat) 

(sat,  equiv  sat) 

(sat,  better  sat). 

(5)  Define  a  number  of  statements.  For  example: 


STATEMENT  TYPE _ POSSIBLE  INSTANCES 


{parameter  =  value}  ( 

(a 2  =  .1}  {a2  =  .15}  {a2  =  .2} 

\ 

[bl  =  1}  {bl  =  2} 

{c2  ‘  =  .1}  {c2  =  .15}  {c2  =  .2} 

{parameter  product  =  value}  \ 

[al*a2  =  .1}  .15}  .21 

f 

bl*b2  =  .1}  .15}  .2 

}  -3}  .4} 

\ 

[cl*c2  =  .1}  .15}  .2] 

[  .3}  .4} 

{quantized  scar_rate  =  value}  {qsr  =  1}  2}  3}  4} 


(6)  i^et  scan_rate  =  a2*na  +  bl*b2*nb  +  cl*c2*nc  for  the 
last  statement  type.  The  number  of  quantization  levels  is 
arbitrary. 


Form  4  classes,  and  weight  the  statement  instances  as  shown: 


CLASS _ ACTION 


(unsat,  unsat) 

Assign  -1  to  every  statement  that  occurs  in  both. 

(sat,  unsat) 

Assign  -1  to  every  statement  that  occurs  only  in 
unsat.  Assign  + 1  to  every  statement  that  occurs  only 
in  sat.} 

(sat,  equiv  sat) 

Assign  + 1  to  every  statement  that  occurs  in  both. 

(sat,  better  sat) 

Assign  + 1  to  every  statement  that  occurs  only  in 
the  better. 

(7)  Sum  the  scores.  Statements  with  highest  scores  are  best. 
Statements  with  lowest  scores  are  poorest. 

(8)  Form  a  candidate  rule  set  for  selecting  parameter 
combinations  having  good  statements  and  no  bad 
statements  (or  the  closest  to  this  situation). 

(9)  Use  these  to  select  the  next  sample.  Perform  new 
comparisons  and  weightings,  refine  the  rules,  and  repeat 
the  process  (several  times,  if  needed). 

(10)  To  build  rules  for  another  situation,  begin  with  the  above 
rules  modified  by  the  initial  knowledge: 

Gradually  decrease/increase  al*a2  as  na  increases/decreases, 

decrease/increase  bl*b2  as  nb  increases/decreases, 

decrease/increase  cl*c2  as  nc  increases/decreases. 

(11)  Refine  these  rules  by  taking  several  samples  using  these 
rules,  then  forming  classes  and  weighting  statements  as 
above. 

This  procedure  was  tried  for  five  sets  of  four  pairs,  using  the  statement 
type  {parameter  =  value}.  The  formulas  in  Appendix  A  were  used  to  calculate  the 
performance  measures,  using  a  weighted  sum  for  overall  measure  (the  acquisition 
measures  received  weight  0.25  since  they  tend  to  be  much  greater  than  track  quality 
measures).  Track  quality  measures  exceeding  100  and  acquisition  measures  exceeding 
125  were  declared  unsatisfactory.  The  results,  using  the  scoring  system  above,  were 
in  the  ballpark  of  the  optimum  combination  (already  calculated)  but  were  not  entirely 


satisfactory.  A  major  problem  was  that  most  of  the  unsatisfactory  cases  had  good 
(low)  overall  measures,  and  the  scoring  system  did  not  allow  their  values  of  overall 
measure  to  be  a  factor.  A  second  scoring  system  was  devised  that  differed  in  that  two 
kinds  of  scores  were  summed  —  one  based  on  overall  measure  and  the  other  based  on 
the  (unsat,  unsat)  and  (sat,  unsat)  pairs  (i.e.,  an  (unsat,  sat)  pair  was  additionally 
scored  as  a  (sat,  better  unsat)  when  the  unsat  case  had  a  lower  overall  measure.  This 
gave  better  results,  but  none  of  the  experiments  resulted  in  the  optimum  combina¬ 
tion. 


Other  statement  types  were  investigated.  The  overall  measure  versus  scan 
time  was  plotted  for  16  parameter  combinations,  to  see  if  scan  time  is  a  good  indica¬ 
tor  of  the  overall  measure.  (Scan  time  can  be  estimated  without  runninga  lengthy 
simulation,  so  would  work  well  as  an  indicator  if  it  correlates  with  performance. 

The  result  was  a  jagged  curve  that  tended  to  be  highest  (poorest)  for  low  scan  times 
(corresponding  to  combinations  with  a2  =  0.1)  and  lowest  (best)  for  medium  scan 
times  (corresponding  to  combinations  with  a2  =  0.15).  This  was  encouraging,  since 
the  optimum  combination  includes  a 2  =  0.15,  but  the  jagged  behavior  of  the  relation¬ 
ship  could  lead  the  learning  system  astray  if  an  unfortunate  set  of  initial  parameter 
combinations  is  chosen.  Figure  A6  in  Appendix  A  shows  the  graph  of  the  overall 
measure  versus  the  scan  time  for  a  typical  situation  choice  (na,  nb,  nc)  =  (28,  3  ,5) 
and  for  various  values  of  bl,  b2,  cl,  and  c2.  Figure  A5  illustrates  performance  meas¬ 
ure  values  for  parameters  resulting  in  the  minimum  value  of  the  overall  measure,  for 
the  same  typical  situation. 

Several  variations  of  this  clustering  method  were  examined,  but  none  pro¬ 
duced  entirely  satisfactory  results.  With  continued  investigation  we  could  probably 
find  a  set  of  statement  types  and  scoring  techniques  that  produce  good  results,  but 
this  would  not  be  consistent  with  our  desire  to  build  a  learning  system  that  requires 
minimal  initial  knowledge. 
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FINDINGS  AND  ACCOMPLISHMENTS 


SYSTEM  STRUCTURE 

After  providing  exact  descriptions  of  the  performance  measures  and  complet¬ 
ing  the  specification  of  an  agile-beam  radar  problem,  we  completed  the  construction 
of  a  production  system  for  setting  parameters  for  this  simplified  model  of  a  radar 
system.  This  time  the  system  was  built  within  the  framework  of  a  more  complex 
learning  production  system  using  the  flexibility  of  the  PRISM  product  ion  system 
architecture  builder. 

The  representation  to  be  learned  was  chosen  to  be  a  production  system  archi¬ 
tecture  because  of  its  transparency  to  human  users  who  may  see  the  results  as  a 
doctrine  described  in  rules.  The  learned  material  is  easily  broken  up  into  comprehen¬ 
sible  units  (the  individual  rules)  which  can  be  separately  analyzed  and  related  to 
goals.  The  modularity  of  rules  also  permitted  incremental  development  within  a 
working  (functioning)  system. 

PRISM  was  chosen  as  the  architecture  builder  because  it  is  capable  of  describ¬ 
ing  a  very  comprehensive  space  of  interesting  production  system  architectures. 
PRISM  facilitated  experimentation  with  architectures  for  learning,  and  eliminated 
some  of  the  routine  programming  involved  in  implementing  new  production  system 
languages. 

The  full  production  system  for  learning  is  a  cluster  of  production  memories, 
each  with  its  own  specialized  task.  Initially,  a  production  memory  called  the  INPUT- 
SITUATION-PM  accepts  user  input  and  initializes  the  declarative  memories  (short¬ 
term  memories)  needed  to  process  the  description  of  the  situation  for  the  case  that  is 
input.  The  format  for  user  input  is  specified  exactly  in  Appendix  E  in  Backus-Naur 
Form.  No  attempt  was  made  to  have  user-friendly  input  or  output  formats  at  this 
stage  since  we  developers  were  the  only  users. 

SYSTEM  GOALS 

The  user  has  the  option  of  specifying  different  goals  depending  on  whether 
the  user  wishes  to  merely  find  some  solution  to  the  parameter-setting  problem 
(GOAL  SATISFYING),  to  find  the  optimum  solution  (GOAL  OPTIMIZING),  the 
system  to  improve  its  ability  to  pick  a  near  optimum  setting  on  the  first  attempt 
(GOAL  LEARNING),  or  to  obtain  a  detailed  monitoring  of  every  decision  made  in 
the  choice  of  parameters  (GOAL  MONITORING). 

GOAL  SATISFYING.  When  the  goal  is  to  satisfy  the  conditions  on  the  prob¬ 
lem,  the  most  recently  learned  productions  for  setting  parameters  are  applied  to 
the  problem  to  return  a  single  solution  along  with  ten  measures  of  its  performance. 
Two  production  memories  are  activated,  SATISFYING-PM  and  PERFORMANCE- 
CHECK-PM. 
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GOAL  OPTIMIZING.  When  the  goal  is  to  obtain  an  optimum  solution,  a 
series  of  such  solutions  are  reported,  with  each  subsequent  one  an  improvement  over 
the  previous  on  its  overall  performance  measure.  The  initial  solution  in  the  series  is 
generated  by  activating  the  SATISFYING-PM  and  PERFORMANCE-CHECK-PM, 
but  subsequent  trials  are  determined  by  using  the  TRY-ANYTHING-PM  along  with 
those  two  long-term  production  memories.  Productions  for  optimizing  were  origi¬ 
nally  housed  in  a  separate  memory,  but  efficiency  considerations  led  us  to  incorporate 
them  in  with  the  productions  for  checking  on  performance.  Although  only  parameter 
choices  with  improved  performance  are  reported,  all  choices  that  are  examined  are 
saved  to  be  used  during  learning. 

GOAL  MONITORING.  When  the  goal  is  to  monitor,  the  system  assumes  an 
optimum  solution  is  desired  and  proceeds  as  in  goal  optimizing  to  produce  a  series  of 
solutions.  The  only  difference  between  goal  monitoring  and  goal  optimizing  is  in  what 
the  system  reports.  In  goal  monitoring,  every  decision  and  action  along  the  path  to 
obtaining  each  solution  is  reported  by  outputting  each  production  rule  that  fires 
along  with  the  situation  in  declarative  memory  that  satisfied  the  conditions  of  the 
rule.  Thus,  eveiy  detail  of  the  considerations  leading  to  the  choices  of  parameter  sets 
is  documented. 

GOAL  LEARNING.  When  the  goal  is  to  learn,  parameter-setting  cases  are 
compared  pairwise,  spans  of  equivalent  values  (equivalent  from  the  point  of  view  of 
what  parameters  would  be  recommended)  among  the  situation  variables  are  deter¬ 
mined,  and  new  productions  are  generated  that  reflect  observed  relations  among  the 
situation  variables  when  certain  choices  of  parameters  have  better  performance  meas¬ 
ures.  The  productions  for  learning  are  housed  in  the  LEARN-PM,  although  much  of 
the  processing  is  accomplished  in  Interlisp  since  PRISM  allows  any  arbitrary  Lisp 
program  to  interface  to  the  structures  in  it.  The  newly  generated  productions  are 
added  to  the  production  memory  for  satisfying  the  constraints  on  a  solution.  Appendi¬ 
ces  F  and  G,  respectively,  contain  the  text  of  one  of  the  learning  programs  and  the  log 
of  a  session  on  the  Xerox  1108  of  user  interaction  with  the  program. 

RESULTS  AND  CONCLUSIONS 

The  conceptual  clustering  system  originally  constructed  for  experimentation 
for  this  project  was  not  elaborated.  The  system  uses  a  model-driven  method  for  con¬ 
structing  nodes  and  minimizes  the  number  of  nodes  in  the  clustering  tree.  However, 
a  minimal  number  of  nodes  in  the  tree  is  neither  a  sign  of  ease  of  access  nor  a  sign  of 
there  being  a  minimal  number  of  tests  for  decisions  made  using  the  tree.  Since  addi¬ 
tional  research  on  conceptual  clustering  revealed  far  superior  work  in  the  area,  minor 
improvements  in  our  own  conceptual  clustering  system  were  not  attempted. 

Some  alternative  approaches  under  consideration  were  found  to  be  inferior. 
This  included  phrasing  the  performance  system  rules  in  terms  of  suggesting  changes 
to  the  current  parameter  choices,  and  decomposing  the  performance  system  into 
separate  subsystems  for  setting  individual  parameters. 
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Task  B  (learning  to  change  parameter  settings)  was  somewhat  misguided,  and 
we  abandoned  it  for  the  following  reasons: 

(1)  Nothing  is  lost  by  a  2-by-2  case  comparison  for  setting  parameters  in 
terms  of  obtaining  feedback  to  the  learner. 

(2)  Unnecessary  additional  complexity  for  rules. 

(3)  Optimum  (best)  choices  need  not  be  near  alterations  of  current  choices. 
(Best  guesses  are  always  the  rational  choice.) 

(4)  Agile-beam  radar  situation  facilitates  radical  changes.  (Radical  change 
may  be  an  advantage  for  hostile  elements  attempting  to  second  guess  our  trackings  of 
them.) 


Prom  the  generate  and  test  view  of  learning,  our  key  insight  was  to  build  into 
the  generator  as  much  of  the  test  as  possible.  The  learning  subsystem  constructs 
additional  productions  to  incorporate  more  and  more  of  the  constraints  on  solutions 
or  the  known  improvement  in  choices.  Adding  conditions  in  a  given  production, 
places  limitations  on  when  the  possible  candidates  will  be  considered  as  suitable 
choices  of  parameters.  This  minimizes  the  search  required  to  obtain  good  solutions. 
Each  check  of  a  candidate  solution  requires  an  elaborate  calculation  of  performance 
measures,  so  transferring  complexity  to  the  productions  is  warranted.  Eventually,  the 
subsystem  that  returns  the  first  solution  to  satisfy  the  constraints  on  a  solution  will 
do  almost  as  well  as  the  optimizing  subsystem. 

The  development  of  the  learning  system  was  driven  by  experiment  and  exam¬ 
ples.  Boundaries  on  the  applicability  of  the  resulting  system  are  a  matter  of  human 
judgment.  Research  is  still  needed  to  construct  the  basis  for  a  coherent  theory  of 
machine  learning.  A  new  field,  computational  learning  theory,  will  contribute  the 
analytical  foundations.  In  addition  to  providing  new  learning  models,  extensions  of 
existing  models,  and  theoretical  comparisons  among  learning  models,  the  new  field 
will  contribute  general  learnability  and  nonlearnability  results  in  existing  models  and 
upper  and  lower  bounds  on  the  required  resources  (time,  space,  number  of  examples). 
Analyses  of  specific  learning  algorithms  will  reveal  their  convergence-rates,  resource 
requirements,  noise  sensitivity,  stability,  and  robustness.  We  would  like  to  direct 
future  efforts  to  this  field. 
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GLOSSARY 


Analogical  inference:  Mapping  information  from  a  known  entity  (event,  object, 
process,  situation)  to  a  similar  one  that  is  not  so  well  known. 

Attribute:  A  variable  or  one-argument  descriptor  used  to  characterize  an  object, 
event,  entity,  or  process.  Example:  scan  rate  for  a  radar. 

Causal  analysis:  Tracing  the  probable  causes  of  observed  events  (occasionally  used  in 
credit  assignment). 

Characteristic  description:  A  concept  description  that  states  properties  characterizing 
all  instances  of  a  given  concept  or  class. 

Characterization:  A  description  that  identifies  the  attributes  of  members  of  a  given 
class  or  instances  of  a  concept. 

Chunking:  Grouping  lower-level  descriptions  (patterns,  operators,  goals)  into 
higher-level  descriptions. 

Composition:  Assembling  a  sequence  of  production  rules  or  operators  into  a  single 
rule  or  operator. 

Concept  acquisition:  Learning  from  examples. 

Concept  description:  A  symbolic  data  structure  defining  a  concept  describing  all 
known  instances  of  the  concept. 

Concept  formation:  A  form  of  learning  in  which  the  learner  generates  concepts  useful 
in  characterizing  a  given  collection  of  objects  or  facts  or  a  subset  of  them. 

Conceptual  clustering:  A  form  of  learning  from  observation  concerned  with  arrang¬ 
ing  entities  (objects,  events,  situations,  facts,  processes,  etc.)  into  classes 
characterized  by  simple  descriptive  concepts  rather  than  into  classes  defined 
solely  by  a  predefined  measure  of  similarity  among  their  members,  as  in 
conventional  clustering. 

Conditions:  Left  sides  of  production  rules  to  be  matched  to  representations  of 
situations  in  working  memory. 

Constraint:  A  property  or  relation  that  restricts  the  space  of  possible  solutions  to  a 
problem. 

Constructive  induction:  An  inductive  learning  process  that  generates  new  descriptors 
not  provided  in  the  description  of  initial  facts  or  observations. 

Credit  (blame)  assignment:  Identifying  the  steps  (decisions,  operators,  etc.)  chiefly 
responsible  for  a  success  (failure)  in  the  overall  process  of  achieving  a  goal. 

Derivational  analogy:  A  case-based  problem  solving  method  in  which  derivations 
of  solutions  to  similar  problems  are  replayed  and  modified  to  solve  new 
problems. 

Description:  A  symbolic  data  structure  defining  a  concept  describing  all  known 
instances  of  the  concept. 


Descriptor:  An  attribute,  function,  (n-ary)  relation,  or  predicate  used  as  an  elemen¬ 
tary  concept  for  describing  entities  (objects,  events,  situations,  processes,  etc.). 

Discriminant  description:  A  concept  description  that  identifies  properties  that 
distinguish  the  given  concept  from  other  concepts  under  consideration. 

Discrimination:  Any  method  for  moving  from  more  general  to  more  specific  descrip¬ 
tions,  that  is,  a  method  for  systematically  searching  the  space  of  descriptions 
in  a  general-to-specific  manner  (the  opposite  of  “generalization,"  second 
meaning). 

Domain  of  a  descriptor:  The  set  of  admissible  values  that  a  descriptor  may  take  as  a 
component  of  a  concept  description. 

Explanation-based  generalization:  A  method  that  uses  domain  knowledge  that 
explains  a  given  example  as  constraints  on  the  construction  of  descriptive 
concepts  that  characterize  that  example. 

Extentionally  identify:  Specify  (all  of)  the  instances  (of  a  concept  or  term). 

Feature:  A  variable  or  one-argument  descriptor  (an  attribute)  used  to  characterize  an 
object,  event,  entity,  or  process. 

Generalization: 

(1)  Any  method  for  generating  some  rule  or  concept  description  from  a  set  of 
instances.  (A  relation  between  inputs  and  outputs  of  a  learning  system  — 
all  learning  systems  cariy  out  generalization  in  this  sense  of  the  term, 
even  if  they  move  from  general  to  more  specific  descriptions.) 

(2)  Any  method  for  moving  from  more  specific  descriptions  to  more  general 
descriptions,  that  is,  a  process  for  systematically  searching  the  space  of 
descriptions  in  a  specific-to-general  manner  (usually  in  response  to  new 
positive  instances  that  were  not  matched  by  an  earlier  description).  (This 
is  the  sense  in  which  I  use  the  term,  except  where  it  appears  as  part  of  a 
term  in  current  use  such  as  explanation-based  generalization.) 

Heuristics:  Imperfect  but  useful  pieces  of  knowledge  employed  in  reasoning  and 
problem-solving  tasks. 

Heuristic  search:  A  problem-solving  method  for  finding  a  sequence  of  operators 
that  transforms  an  initial  state  into  a  desired  god  state.  Search  strategies 
used  to  generate,  test,  and  prune  operator  sequences.  Intensional  definition: 
Characterization. 

Intensionally  identify:  Characterize. 

Intermediate  measures  (intermediate  features  of  conditions  or  parameters):  Compos¬ 
ite  (macro)  characteristics  constructed  of  elementary  or  primitive  attributes 
that  combine  to  improve  the  “grain-size”  of  reasoning  in  the  domain. 

Instantiation:  Specifying  values  to  fill  in  the  slots  in  a  schematic  concept. 

Knowledge  compilation:  Translating  knowledge  from  a  declarative  form  that  cannot 
be  used  directly  into  an  effective  procedural  form. 


Machine  learning;  A  subdomain  of  artificial  intelligence  concerned  with  developing 
computational  models  of  learning,  that  is,  systems  that  improve  over  time. 

Macro-operator:  An  operator  composed  of  a  sequence  of  more  primitive  operators. 
Appropriate  macro-operators  simplify  problem  solving  by  allowing  larger 
steps  to  be  taken  towards  a  solution  and  reducing  search. 

Means-ends  analysis:  A  problem-solving  method  that  searches  at  each  step  for  opera¬ 
tors  that  maximally  reduce  the  differences  between  the  current  state  and  a 
known  goal  state. 

Metalevel  inference:  A  technique  in  which  control  information  expressed  declara- 

tively  (usually  in  the  form  of  explicit  rules)  is  separated  from  factual  informa¬ 
tion  in  order  to  form  a  metalevel.  Inference  at  the  metalevel  induces  inference 
at  the  object-level.  Search  at  the  object-level  is  replaced  by  search  at  the 
metalevel.  (See  Silver,  1986.) 

Neural  network:  A  network  of  neuron-like  elements  that  performs  some  simple  logi¬ 
cal  function,  typically  a  logic  threshold  function  (LTF)  or  a  sigmoidal  function. 
Minsky  (1967)  showed  that  networks  of  LTFs  possess  the  computational 
power  of  a  Turing  machine. 

Operationalization:  Knowledge  compilation. 

Parameter:  An  independent  variable  whose  value  contributes  to  determining  the 
functioning  of  a  system  (in  this  case  a  sensor  or  communication  system). 

Precondition  analysis:  A  method  principally  for  learning  problem-solving  strategies 
from  worked  examples,  combining  metalevel  inference  with  concepts  from  the 
field  of  planning. 

Predicate:  A  statement  that  is  either  true  or  false. 

Proceduralization:  The  conversion  of  declarative  information  into  procedural  form. 

Production  rule:  A  condition-action  pair,-  stating  that  the  action  is  to  be  performed  if 
the  condition  is  matched  or  satisfied. 

Proportionality  graphs:  An  undirected  graph  in  which  nodes  represent  variables 
and  edges  represent  the  existence  of  either  a  direct  or  inverse  qualitatively 
proportionality  relation  between  the  two  variables. 

Schema:  A  symbolic  structure  that  can  be  filled  in  by  specific  information  (instan¬ 
tiated)  to  create  an  instance  of  the  generic  concept  represented  by  the 
structure. 

Specialization:  Any  method  for  moving  from  more  general  to  more  specific  descrip¬ 
tions,  that  is,  a  method  for  systematically  searching  the  space  of  descriptions 
in  a  general-to-specific  manner.  (The  opposite  of  “generalization”  in  its 
second  meaning) 

Structural  description:  A  symbolic  representation  of  objects  and  concepts  based  on 
descriptions  of  their  parts  and  the  relationships  among  them. 
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Transformational  analogy:  A  problem-solving  method  in  which  a  solution  to  a  similar 
problem  is  incrementally  modified  into  a  solution  to  the  new  problem. 

Units  analysis:  A  technique  that  imposes  constraints  on  the  construction  of  new 

terms  from  old  to  assure  that  the  new  terms  can  have  some  reasonable  inter¬ 
pretation.  Example:  meters  may  be  divided  by  seconds  but  not  added  to  sec¬ 
onds.  (If  one  variable  has  as  its  units  the  power  of  that  of  smother,  they  may 
be  added  once  the  second  is  raised  to  that  power.) 

Version  space:  A  set  of  candidate  concept  descriptions  that  are  consistent  with  the 

training  data,  the  knowledge,  and  the  assumptions  of  the  concept  learner.  This 
set  defines  a  partially  learned  concept  and  can  be  represented  by  its  maximally 
general  and  maximally  specific  members. 

Weak  methods:  General  methods  for  problem  solving  applicable  in  the  absence  of 
specific  knowledge  of  the  problem  domain.  Examples:  means-ends  analysis 
and  heuristic  search. 
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A  TWO-DIMENSIONAL  AIR  RADAR  EXAMPLE 


A  simplified  version  of  the  example  given  in  Dillard  (1986)  for  a  two- 
dimensional  air-search  radar  is  described  here.  The  simplifications  are  the 
following;  (1)  the  pulse  duration  is  10  nsec  instead  of  a  choice  between  2  nsec 
and  100  nsec,  and  (2)  only  three  per-beam-position  target  situations  are  considered 
rather  than  the  six  described  there.  Besides  these  changes,  an  additional  value  of 
dwell  time  (0.15  sec)  is  allowed.  The  pertinent  specifications  of  this  radar  are: 

•  agile  fan  beam,  10-degree  beamwidth 

•  10  nsec  pulse  duration 

•  162  nmi  instrumented  range 

•  300  pulses  per  sec 

•  dwell  time  per  beam  =  0.10  sec  (30  pulses),  0.15  sec  (45  pulses), 
or  0.20  sec  (60  pulses) 

•  looks  (beams)  per  beam  position  per  scan  =  1  or  2 

A  scan  is  completed  when  each  beam  position  has  had  at  least  one  look.  Since  the 
antenna  scans  360  degrees  with  a  10-degree  beamwidth,  the  total  number  of  beam 
positions  is  36.  The  range  resolution  corresponding  to  a  10  nsec  pulse  is  0.8094  nmi, 
resulting  in  about  200  range-resolution  cells  per  beam. 

SITUATION  PER  BEAM  POSITION 

In  each  of  the  36  beam  positions,  one  of  three  possible  situations  can  occur. 

Situation  a:  DEFAULT.  No  track  is  likely  to  continue  in  that  beam,  and  there  is  no 
indication  from  intelligence  or  electronic  support  measures  (ESM)  that 
a  target  is  likely  to  enter  from  that  direction. 

Situation  b:  HIGH  SPEED.  A  target  that  could  be  in  that  beam  is  travelling  at  high 
speed. 

Situation  c:  OTHER.  At  least  one  target  is  believed  to  be  in  that  beam  (but  not  a 
high-speed  target)  and/or  intelligence  from  other  sensors  indicate  a 
target  might  be  entering  from  that  direction  at  any  time. 

SITUATION  PER  SCAN 

Recall  that  a  scan  is  a  sequence  of  looks  (beam  pointings)  such  that  each  beam 
direction  receives  at  least  one  look.  On  any  given  scan,  let 

na  =  number  of  beam  positions  believed  to  have  situation  a, 

nb  =  number  of  beam  positions  believed  to  have  situation  b, 

and 

nc  =  number  of  beam  positions  believed  to  have  situation  c. 
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Since  there  are  36  beam  positions,  the  sum  of  these  numbers  is  36,  i.e.,  na  -l-  nb  +  nc 
=  36.  Figure  A1  shows  the  possible  situations  that  can  occur  on  any  given  scan. 

Based  on  the  values  of  na,  nb,  and  nc,  values  of  the  variable  parameters  are 
selected  for  the  next  scan.  Since  there  are  36  beam  positions,  the  number  of  possible 
situations  is  37*38*72  =  703.  Most  of  these  are  unlikely  to  occur,  so  can  be 
disregarded. 


no.  of  DEFAULT 

no.  of  HIGH-SPEED 

no.  of  OTHER 
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Figure  A1 .  Situation  space . 
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PARAMETER  SELECTION  STRATEGIES 


During  each  scan,  the  two  parameters  that  can  be  varied  for  each  beam 
position  are  (1)  the  number  of  looks  (beams)  in  that  direction  during  that  scan, 
and  (2)  the  dwell-time  per  look.  The  simplest  strategy  would  map  the  situation 
(na  nb  nc)  into  a  selection  of  values  of  the  parameters  al  a2  bl  b2  cl  c2,  shown 
in  the  chart  below. 


per-beam-position  parameter 


beam  situation  looks_per_scan  dwell_time  (seconds) 


a  al  =  1  a2  =  0.1,  0.15,  or  0.2 

b  bl  =  1  or  2  b2  =  0.1, 0.15,  or  0.2 

c  cl  =  1  or  2  c2  =  0.1, 0.15,  or  0.2 

Figure  A2  gives  the  reasonable  combinations  of  parameter  values  that  can  be 
chosen  under  this  strategy.  The  goal  is  to  determine  the  current  target  situation 
(i.e.,  determine  for  each  beam  position  if  the  situation  is  a,  b,  or  c)  and  to  use  the 
best  parameter  combination  for  that  situation  (i.e.,  to  use  the  best  mapping  of  the 
form:  na  nb  nc  — >  al  a2  bl  b2  cl  c2). 

A  serious  problem  with  this  simple  strategy  is  that  weak  (long-range  or  small) 
targets  can  have  a  veiy  low  probability  of  initial  detection.  A  better  strategy 
may  be  to  alternate  the  value  of  dwell_time,  (e.g.,  alternate  it  between  0.1  sec 
and  0.2  sec  in  those  beam  positions  which  would,  otherwise,  continuously  have 
a  0.1  sec  dwell  time).  There  are  various  ways  of  specifying  rules  for  varying  dwell 
time.  We  arbitrarily  chose  the  following  as  an  example. 


A-4 


The  simplest  strategy  (dwell_time  not  alternated)  calls  for  values  of  a2,  bl,  b2, 
cl,  and  c2  to  be  selected  for  the  next  scan,  based  on  the  current  situation  (na,  nb,  nc). 
Out  of  108  possible  combinations,  all  but  the  42  listed  here  are  eliminated  by  bias 
constraints  b2  >  =  a2,  c2  >  =  a2,  bl  >  =  cl. 
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Dwell-time  alternation  rule:  Every  default  (situation  a)  beam  position  which 
has  had  a  0.1-sec  dwell  time  for  the  previous  da-1  scans  will  have  a  0.2-sec  dwell 
time  on  the  next  scan.  Every  default  beam  position  will  have  a  0.2-sec  scan  on  at 
least  1  of  every  da  scans.  Similarly,  every  beam  position  with  situation  b  (high  speed) 
will  have  a  0.2-sec  scan  on  at  least  1  of  every  db  scans  and  every  beam  position  with 
situation  c  will  have  a  0.2-sec  scan  at  least  1  of  every  dc  scans. 

The  mapping  for  this  rule  is  (na  nb  nc)  —  >  (al  da  bl  db  cl  dc).  It  may  be 
that  db  and  dc  are  unity  under  this  strategy. 

A  major  problem  is  determining  the  current  target  situation.  Rules  are 
needed  for  determining  whether  the  situation  in  a  beam  position  is  a,  b,  or  c.  The 
accuracy  of  the  determination  depends  partly  on  the  current  strategy  and  associated 
parameter  values.  An  optimum  strategy  would  also  have  adaptive  rules  for  acquiring 
and  tracking  weak  targets.  These  rules  could  also  be  refined  with  learning  techni¬ 
ques.  Acquisition  of  a  target  conventionally  requires  two  or  more  detections. 
Reasonable  rules  can  be  specified  arbitrarily,  but  learning  procedures  should  be 
applicable  also  to  improving  acquisition  rules. 

TARGET  TYPES 

Performance  measures  of  target  acquisition  and  track  quality  will  be 
calculated  for  four  kinds  of  targets: 

Target_W:  high-speed,  weak  target 

Target  X:  high-speed,  average-strength  target 

Target  Y:  average-speed,  weak  target 

Target  Z:  average-speed,  average-strength  target 

A  “weak  target”  could  be  an  average-size  aircraft  at  maximum  range  or  a  small 
target  at  midrange.  An  “average-strength  target”  could  be  an  average-size  target  at 
midrange  or  a  smaller/closer  or  larger/farther  target.  Arbitrarily,  let  “high  speed”  be 
1000  knots  and  “average  speed”  be  400  knots.  All  are  assumed  to  be  radial  targets; 
i.e.,  they  remain  in  a  single-beam  position,  flying  directly  toward  the  radar. 

FORMULAS 

Let  FAR  denote  the  false-alarm  rate  (alarms  per  hour)  and  PFA  denote  the 
probability  of  a  false  alarm  per  resolution-cell  decision.  For  a  constant  FAR,  the  PFA 
in  beams  having  a  0.2-sec  dwell  should  be  twice  as  great  as  for  a  0. 1-sec  dwell,  and 
should  be  1.5  times  as  great  for  a  0.15-sec  dwell.  Since  there  are  200  resolution  cells 
per  beam  position,  we  have 

FAR  =  200  *  3600  (sec/hr)  *  PFA  /  0.1  sec 
=  7.2E6  *  PFA 

where  PFA  is  the  value  of  PFA  for  a  0.1-sec  dwell  time. 
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For  the  simplest  strategy  (dwell  time  value  not  alternated),  the  time  to 
complete  one  full  scan  (in  seconds)  is 

scan_time  =  a2*na  +  bl*b2*nb  +  cl*c2*nc 

Under  the  dwell-time  alternation  strategy,  an  approximation  to  the  scan  time  is 

scan_time  =  0.1  *  [na  +  na/da  +  bl  *  (nb  +  nb/db)  +  cl  *  (nc  +  nc/dc)] 

This  approximation  assumes  that  the  dwell  time  alternates  randomly  among  the 
beams  or  is  staggered,  rather  than,  e.g.,  all  default  beams  switching  to  the  0.2-sec 
dwell  on  the  same  scan. 

For  any  strategy,  the  minimum  value  of  the  scan  time  is  0.1  sec  *  36  beam 
positions  =  3.6  sec,  and  the  maximum  value  is  0.2  sec  *  2  looks  *  35  4-  0.2  sec  = 

14.2  sec.  (If  all  beam  positions  receive  2  looks,  then  the  scan  really  becomes  2  scans, 
by  definition  of  a  scan.) 

The  time  that  a  radial  target  remains  in  any  resolution  cell  is  time_in_cell  = 
range jresolution  /  speed. 

Since  the  range  resolution  is  0.8094  nmi,  the  value  for  a  high-speed  target  is 
time_in_cell  =  0.8094  *  3600  /  1000  =  2.914  sec 
and  for  an  averagespeed  target  is 

time_in_cell  =  0.8094  *  3600  /  400  =  7.2846  sec. 

The  average  number  of  looks  at  a  target  while  it  remains  in  a  single  resolution 

cell  is 


looks_per_cell  =  looks_per_scan  *  time_in_cell  /  scan  time. 

To  compute  the  maximum  value  of  looks__per_cell,  we  assume  an  average- 
speed  target,  a  0.1-sec  dwell  time  in  every  beam  position,  and  2  looks  in  only  that 
one  beam  position,  giving  scan_time  =  0.1  sec  *  (35  +  2)  =  3.7  sec.  The  maximum 
looks_per_cell  is  then  2  looks  *  (7.2846  sec/cell)  /  3.7  sec  =  3.94  looks.  To  compute 
the  minimum  value  of  Iooks_per_  cell,  we  assume  a  high-speed  target  that  has  not 
yet  been  detected,  with  2  looks  in  all  beam  positions  except  this  one  and  a  0.2-sec 
dwell_time  in  all  positions.  The  scan  time  is  then  35  *  (0.2  sec  *  2  looks)  +  0.2  sec  = 
14.2  sec,  and  the  minimum  looks_per_cell  is  (2.914  sec/bin)  /  (14.2  sec/scan)  =  0.2052 
looks.  The  value  range  of  looks_per_cell  is,  therefore,  roughly  0.2  to  4.0. 

For  the  simple  strategy,  the  average  number  of  times  a  target  will  be  detected 
while  in  a  single  resolution  cell  is 

detections_per_cell  =  looks_per_cell  *  detection_probability. 
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The  detection  probability  (per  look)  is  a  function  of  the  false-alarm  probability, 
the  dwell  time,  and  the  target  strength.  For  a  fixed  value  of  PFA,  the  detection 
probabilities  need  be  computed  (or  read  from  a  graph)  for  only  six  cases: 

•  0.1-sec  dwell,  average  strength 

•  0.1-sec  dwell,  weak 

•  0.15-sec  dwell,  average  strength 

•  0.15-sec  dwell,  weak 

•  0.2-sec  dwell,  average  strength 

•  0.2-sec  dwell,  weak 

For  a  false-alarm  rate  of  7.2  per  hour  (i.e.,  FAR  =  7.2),  the  values  of  detection 
probability  for  these  six  cases,  respectively,  are  0.6456,  0.1365,  0.9315,  0.38417, 
0.9921,  and  0.6443,  assuming  noncoherent  integration  and  a  nonfluctuating  target 
with  a  signal-to-noise  ratio  of  1  dB  if  average  strength,  and  -1  dB  if  weak.  (The 
probability  of  a  false  alarm  is  PFA  =  0.000001  for  a  0.1  sec  dwell,  PFA  =  0.0000015 
for  a  0.15  sec  dwell,  and  PFA  =  0.000002  for  a  0.2  sec  dwell.) 

Figure  A3  lists  formulas  for  detections_per_cell  for  each  target  type,  for 
target  acquisition,  and  track  quality  cases  when  using  the  simple  strategy.  Since 
the  acquisition  performance  measures  assume  that  the  situation  in  the  beam  prior 
to  detection  of  the  target  is  situation  a,  the  value  of  na  used  when  computing  track 
quality  measures  is  greater  by  unity  than  the  value  for  acquisition  measures  and  the 
value  of  nb  or  nc  is  less  by  unity.  (We  assume  that  the  situation  in  the  other  beams 
remains  stable.) 

For  the  dwell-time  alternation  strategy,  the  average  number  of  detections 
per  cell  can  be  approximated  by  substituting  for  detection_probability  the  quantity: 
(Pd[0.2  sec  dwell]  +  (d  -  1)  *  Pd[0.1  sec  dwell])  /  d,  where  d  is  da,  db,  or  dc  for  beam 
situations  a,  b,  or  c,  respectively. 

PERFORMANCE  MEASURES 

The  component  performance  measures  will  be: 

•  FAR_units 

•  targ_W_acquis_units,  targ_X_acquis_units,  targ  Y  acquis  units, 
targ_Z_acquis_units 

•  track_W_qual_units,  track_X_qual_units,  track_Y_qual_units, 
track_Z_qual_units 

The  measure  FAR_units  is  a  function  of  the  false-alarm  rate.  Acquisition  measures 
assume  that  the  values  of  the  parameters  used  in  that  beam  (looks_per_scan  and 
dwell_time)  are  those  for  the  default  mode  (al  and  a2  under  the  simple  strategy). 
Track  quality  measures  assume  that  the  parameter  values  used  in  that  beam  are 
those  for  the  high-speed  mode  if  target_W  or  target_X,  and  those  for  the  other  mode 
if  target_Y  or  target  Z.  The  target  acquisition  and  track  quality  measures  will  be 
functions  of  the  average  number  of  detections  of  that  target  in  a  resolution  cell  (i.e., 
detect  ions_per_cell). 
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DETECTIONS  PER  CELL 


Target 

Default  Parameters 
(for  acquisition  cases) 

Parameters  Matched  to  Target 
(for  track-quality  cases) 

W 

2.914  *  Pdfa2.  weakl 

2.914  *  bl  *  Pdrb2.  weakl 

(fast) 

scan_time 

scan_time 

X 

(fast) 

2.914  *  Pdfa2.  avgl 
scan_time 

2.914  *  bl  *  Pdfb2.  avtrl 
scan_time 

Y 

1 

scan_time 

scantime 

Z 

7.285  *  Pdfa2.  avgl 
scan_time 

7.285  *  cl  *  Pdfc2.  avgl 
scantime 

scantime  =  a2*na  +  bl*b2*nb  +  cl*c2*nc 

Figure  A3.  Formulas  for  computing  the  values  of  detections jjer  cell  for  each 
target  type,  for  the  target  acquisition  case,  and  the  track  quality  case.  (Simple 
strategy  -  dwell  time  not  alternated.) 

To  minimize  computations  for  initial  experiments,  a  single  formula  can  be 
used  for  all  target-acquisition  and  track-quality  measures.  We  have  devised  the 
following  formula. 

<  >_units  =  170  *  exp(-3. 52636  *  detections_per_cell) 
if  detections_per_cell  >  1 

=  8.55  *  exp(-0.5365  *  detections_per_cell)  otherwise. 

Although  the  value  of  FAR_units  is  not  important  in  our  experiments  (for 
reasons  discussed  below),  a  formula  that  can  be  used  is  the  following. 

FAR_units  =  120  *  exp(2  *  ((log  FAR)  -  2.1)) 

The  overall  performance  measure  (overall_measure)  can  be  the  sum  of  the 
component  performance  measures  or  a  weighted  sum.  Since  the  acquisition  measures 
tend  to  be  much  greater  than  the  track  quality  measures,  these  have  been  given 
weight  0.25  in  learning  experiments. 

COMPUTATIONS 

A  reasonable  approach  is  to  select  a  few  values  of  FAR  within  a  practical 
range  and  use  the  learning  system  to  determine  the  best  set  of  control  rules  for  each 
one.  (The  same  or  very  similar  set  of  rules  likely  will  result  from  all  practical  values 
of  FAR,  so  the  result  for  one  value  could  be  a  starting  set  of  rules  for  the  next.)  The 
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performance  for  several  values  of  FAR  can  then  be  compared  in  a  final  stage.  The 
operator  often  will  prefer  to  set  the  false-alarm  rate  to  a  value  considered 
appropriate  for  the  moment. 

Sample  values  of  track-quality  performance  measures  for  the  single-target 
case  are  given  in  figure  A4,  for  the  simple  strategy.  The  false-alarm  rate  assumed  for 
this  case  is  7.2  alarms  per  hour.  The  acquisition  measures  for  acquiring  the 
respective  targets  (while  using  default  parameters  in  all  36  beam  positions)  have  the 
same  values  as  the  last  set  of  track  quality  measures  (the  1  look,  0.1-sec  dwell  case). 
It  is  important  to  note,  though,  that  the  acquisition  measures  computed  for  a  given 
na,  nb,  and  nc  pertain  to  a  new  target  of  the  respective  type  (in  a  beam  position 
having  default  parameters),  and  not  to  the  acquisition  of  any  targets  currently  being 
tracked. 


TARGET: 

W 

(na  nb  nc) 

X 

=  (35  1  0) 

Y 

(na  nb  nc) 

Z 

=  (35  0  1) 

TRACK  QUALITY 

2  looks 

(0.963) 

(1.483) 

(2.407) 

(3.706) 

0.2-sec  dwell 
(3.9-sec  scan) 

5.70 

3.86 

2.35 

1.17 

TRACK  QUALITY 

2  looks 

(0.215) 

(1.017) 

(0.538) 

(2.542) 

0.1-sec  dwell 
(3.7  sec  scan) 

79.65 

4.95 

25.54 

2.19 

TRACK  QUALITY 

1  looks 

(0.507) 

(0.781) 

(1.269) 

(1.953) 

0.2-sec  dwell 
(3.7-sec  scan) 

28.401 

10.81 

4.33 

3.00 

TRACK  QUALITY 

1  looks 

(0.110) 

(0.523) 

(0.276) 

(1.306) 

0.2-sec  dwell 
(3.6-sec  scan) 

115.14 

26.92 

64.18 

4.24 

Figure  A4.  Values  of  detections_per_cell  (in  parentheses)  and  track 
quality  measure  for  the  single  target  case,  assuming  the  simple 
strategy,  a  false  alarm  rate  of  7.2  per  hour,  and  a  0.1 -sec  dwell 
In  the  default  beams.  (Recall  that  performance  is  measured  in  units 
of  rejection,  so  a  low  value  is  good.) 
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The  situation  (na,  nb,  nc)  —  (28, 5,  3)  was  chosen  for  most  experiments.  The 
optimum  set  of  parameters  was  found  to  be  a2  =  0.15,  bl  =  2,  b2  =  0.2,  cl  =  1,  and 
c2  =  0.2.  Figure  AS  gives  a  printer  listing  of  component  performance  measures  and 
the  overall  measure. 

Performance  Measure  Values  for  Parameters  with  Optimum  Performance 

(na  nb  nc)  =  28  3  5 

(a2  bl  b2  cl  c2)  =  0.15  2.00  0.20  1.00  0.20 

Scan  time  =  6.400001 

W:det/cell  (acq)  =  .2933578 

X:det/cell  (acq)  =  .4517155 

Y:det/cell  (acq)  =  .7306764 

Z:det/ceU  (acq)  =  .1.129289 

W:det/cell  =  .5867156 

X:det/cell  =  .9034309 

Y:det/cell  =  .7333945 

Z:det/cell  =  .1.129289 

FARunits  =  9.996 

Wacquunits  =  60.41957  W_qual_units  =  21.47367 

X_acqu_units  =  34.56658  X_qual_units  =  7.028518 

Y_acqu_units  =  12.92509  Y_qual_units  =  12.80179 

Z_acqu_units  =  4.664908  Z_qual_units  =  4.664908 

Overallmeasure  =  84.10893 

Figure  A5.  Performance  measure  values  for  parameters  resulting  in  the  minimum 
value  of  the  overall  measure,  for  the  typical  situation  (na.  nb,  nc)  =  (28,  3, 5). 

(Acquisition  units  are  weighted  by  a  factor  of  .25  for  the  overall  measure.) 

In  the  experiments  involving  clustering  methods  for  task  A,  we  examined  the 
relationship  between  the  overall  performance  measure  and  the  scan  rate.  This 
relationship  is  illustrated  in  Figure  A6  and  is  described  under  the  section 
“Experiments.” 
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OVERALL  MEASURE 


Overall  Measure  Versus  Scan  Time  (for  a  typical  situation) 


®  SIGNIFIES  UNSATISFACTORY 


Figure  A6.  Overall  measure  versus  scan  time  for  (na,  nb,  nc)  =  (28,  3,  5)  and  for  various 
values  of  a2,  bl ,  b2,  cl ,  and  c2. 
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APPENDIX  B 


Preference  Criteria  for  Hypotheses 
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PREFERENCE  CRITERIA  FOR  HYPOTHESES 

Simplicity  of  hypotheses 
of  conditions 

of  features  and  concepts  used 
of  actions  or  consequents. 

Generality  of  hypotheses  (more  general  hypotheses  may  be  more  economical  as  ways 
to  compress  information,  but  more  specific  ones  tend  to  be  closer  to  the  data 
and  do  not  go  beyond  it  so  recklessly). 

Cost  of  using  hypotheses  for  decisions 

cost  of  detecting  features 

cost  of  establishing  matches  for  the  conditions  (simplicity  affects  this) 
number  of  tests 

distribution  of  cases  requiring  multiple  tests 

(in  a  hierarchy  of  concepts  which  is  organized  to  minimize  the 
number  of  nodes,  there  could  be  a  distribution  of  the  cases 
which  is  less  economical  to  process  than  if  the  concepts  were 
organized  in  some  other  way) 

cost  of  conflict  resolution  between  competing  hypotheses. 

Degree  of  approximation  to  the  facts 

proportion  of  times  the  hypothesis  applies  correctly  to  the 

number  of  times  it  applies 

vagueness  of  the  hypothesis  (in  formats  expressing  numerical  values 

as  mean  and  standard  deviation,  for  example,  a  smaller  standard 
deviation  is  preferred  to  a  larger) 

precision  of  the  prototype  for  concepts  expressed  as  prototypes. 

Interconnectivity  to  other  hypotheses  (using  features  which  are  common  to  a  lot  of 
other  hypotheses  may  be  preferable  to  using  entirely  new  features  since  there 
will  be  a  difference  in  what  can  be  inferred). 

Ease  of  determining  what  node  an  arbitrary  case  falls  under. 
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Parameter  Changes 
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PARAMETER  CHANGES 

How  shall  we  describe  changes  in  parameter  settings?  For  the  purpose  of 
generating  rules,  we  would  like  to  have  as  few  variants  on  the  operators  as  possible. 
This  poses  a  problem  for  the  description  of  parameter  changes  because  there  are  so 
many  ways  to  make  alterations  in  the  parameter  settings.  The  grainsize  of  the 
changes  can  be  varied,  not  only  within  a  metric  (e.g.,  nominal,  ordinal,  interval,  ratio, 
absolute),  but  descriptions  of  parameters  can  be  revised  and  converted  between 
metrics. 

Operators  for  changing  parameters  could  specify 

I.  Ordinal 

large  positive  change 
large  negative  change 
no  change 
OR 

large  positive  change 
medium  positive  change 
small  positive  change 
no  change 

small  negative  change 
medium  negative  change 
large  negative  change 

II.  Metric  (digital)  units  (These  will  have  to  be  specific  to  a  given  parameter,  based 
on  understanding  of  the  domain) 

a.  one  unit  at  a  time  (greater,  no  change,  or  less) 

b.  n  units  at  a  time  (greater,  no  change,  or  less) 

c.  logarithmic  (or  other  power,  2**n,  log(n),  etc.)  scale  units  at  a  time 
(greater,  no  change,  or  less). 

The  situation  becomes  all  the  more  complex  when  multiple  parameters  are  to 
be  changed  simultaneously.  We  are  imposing  constraints  on  when  that  will  be 
considered  to  make  the  search  tractable. 
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Terminating  Conditions  for  the  Learner 
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TERMINATING  CONDITIONS  FOR  THE  LEARNER 

For  a  particular  optimal  parameter  setting,  the  options  are 

a)  Number  of  trials  since  the  latest  improvement, 

b)  Time  of  processing, 

c)  Exhausted  the  space  of  possibles  to  test,  so  we  take  the  best  found, 

d)  A  preset  performance  goal  within  a  certain  epsilon  distance, 

e)  A  beam  search  of  depth  d  revealing  no  improvements  in  performance,  and 

f)  N  seed  conditions  all  having  beam  searches  of  depth  d  with  no  improvement. 

For  a  complex  multisensor  system,  a  candidate  goal  recognizing  rule  could  be: 

IF  you  have  radar  rl,...,rn  from  which  {ri}  R  have  been  selected,  and  for  each  ri 

selected,  parameters  pil-pij  are  set,  and  for  all  performance  measures  each  is 
below  the  maximum  value  allowable,  and  the  performance  measures  meet  the 
balance  criterion 

THEN  you  are  finished. 

When  are  we  done  learning  parameter  control  doctrine?  Probably  never,  but 
signs  that  we  may  be  done  would  include: 

Relative  strengths  on  heuristic  rules  stabilize 

No  new  rule  variants  are  generated 

All  expected  scenarios  have  been  represented  by  instances  (cases)  presented  to 
the  learner. 
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Backus-Naur  Form  Specification  of  a 
Language  for  Inputting  the  Description  of 
a  Problem  to  the  Learning  Programs 
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BACKUS-NAUR  FORM  SPECIFICATION  OF  A  LANGUAGE 
FOR  INPUTTING  THE  DESCRIPTION  OF  A  PROBLEM  TO 
THE  LEARNING  PROGRAMS 

<  parameter-setting-task  >  ::=  (  <  situation  >  )  | 

(  <goal>  <  situation  >  ) 

<goal>  ::=  (GOAL  <type>  ) 

<type>  ::=  SATISFYING  |  {returns  the  first  set  of  parameters  which  meet  the 

constraints  on  a  solution} 

OPTIMIZING  |  {returns  a  series  of  sets  of  parameters,  each  with  its 
associated  performance  measures.  The  next  set  in  the 
series  must  be  an  improvement  in  performance  over 
the  previous  on  the  overall  performance  measure} 

LEARNING  |  {returns  a  series  of  sets  of  parameters  as  in  the 

optimizing  goal  and  subsequently  improves  both  the 
optimizing  and  the  satisfying  production  memories} 

MONITORING  {returns  details  of  the  considerations  leading  to  the  the 
choice  of  parameter  sets} 

<  situation  >  ::=  <na-nb-nc>  | 

<  current-beam  >  | 

<far>  | 

<far>  <  situation  >  | 

<  situation  >  <far>  j 

<  current-beam  >  <  situation  >  | 

<  situation  >  <  current-beam  >  j 
<na-nb-nc>  <  situation  >  | 

<  situation  >  <na-nb-nc> 

< current-beam >  ::=  (CURRENT-BEAM  <curr-beam>  ) 

<curr-beam>  ::=  DEFAULT  | 

HIGH-SPEED  | 

<  other  > 

<  other >  ::=  OTHER 

<far>  ::=  (FAR  < decimal  num>  ) 

<na-nb-nc>  ::=  <  num-for-na-nb-nc  >  j 

<  na-nb-nc  >  <  num-for-na-nb-nc  > 

<  num-for-na-nb-nc  >  ::=  (  na  <num>  )  | 

(  nb  <  num  >  )  | 

(  nc  <  num  >  ) 

<num>  ::=  36  |  35  |  34  |  33  |  32  |  31  |  30  |  29  |  28  |  27  |  26  |  25  |  24  | 

23  |  22  |  21  |  20  |  19  |  18  |  17  |  16  j  15  |  14  |  13  |  12  j  11  | 

10  j  9  |  8  |  7  |  6  |  5  |  4  |  3  |  2  |  1  |  0 
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TEXT  OF  THE  LEARNING  PROGRAM,  DISCRIM 


Listing  o-F  File  <FLOPPY>DISCRIM  ,  3-Nov-B7  12:17:18  by 

(CREATE-COHPQNENT  CURRENT-CASE-NH 

INSTANCE-OF  DECLARAT IVE-NERORY ) 

(CREATE-COHPQNENT  PREV !QUS-CASE-«« 

1NSTANCE-0F  DECLARAT IVE-HERORY) 

(CREATE-COHPQNENT  CflSEHBI 

INSTANCE-OF  DECLARATIVE-HEHORY! 

(CREATE-CGNPGNENT  THIS-CASE-ilH 

lNSTANCE-GF  DECLARAT IVE-NERGRY) 

(CREATE-CCMPGNENT  BEST-PERFORNANCES-NH 
INSTANCE-GF  DECLARATIVE-HEHORY i 

(CREATE-COHPQNENT  TRIES-MH 

INSTANCE-OF  DECLARATIVE-HEHORY! 

(CREATE-COHPQNENT  LEAAN-HK 

INSTANCE-QF  DECLARAT I VE-KEMORY } 

iCREATE-CGKPGHEHT  CAHD ! DATE-RELAT I0«S- KP! 

INSTANCE-OF  DECLARAT I VE-HEMORY > 

(CREATE-COHPQNENT  QID-CASE-NH 

INSTANCE-OF  DECLARATIVE-HEHORY) 

(CREATE-C0HPONENT  SAT ISFYIMB-PN 

INSTANCE-OF  PROCEDURAL-NENORY 
MATCHES- AGA INST  TRIE5-NM 
DEFAULT-ACTIONS  ((IADD-TO  Nil  ({RESULT)!)! 

(CREATE-CGHPONENT  PERFORHANCt-CHECK-PH 
INSTANCE-OF  PROCEDURAL-MEMORY 
RATCHES-A6AINST  HR 

DEFAULT-ACTIONS  ( (IADD-TO  HR  ({RESULT! ))! 

(CREATE-CGRPGNENT  TRY-AHYTHING-PH 

INSTANCE-GF  PROCEDURAL -HENDRY 

MATCHES-ASAENST  TRIES-NH 

DEFAULT-ACTIONS  l (IADD-TO  TRIES-NH  If RESULT!  I ) ) 

(CREATE-COMPONENT  INP'JT-SITl'ATIGN-PH 
INSTANCE-OF  PROCEDURAL-MEMORY 
HATCHES-A6AINST  TRIES-NN 
DEFAULT-ACTIONS  ((IADD-TO  TRIES-NH  ({RESULT) ) I ) 

(CREATE-COMPONENT  LEARNING -PH 

INSTANCE-OF  PROCEDURAL-MEMORY 
HATCHE5-AGAINST  CL'RRENT-CASE-NH 
DEFAULT-ACTIONS  ((IADD-TO  LEARN-NR  (IRES'JLTI ! , ! 

(CREATE-CGNPGNENT  LEARN-FROH-DIFFERENCES 
INS'^NCE-GF  D1 SCSININAT ION-PROCESS! 


(CREATE-COHPQNENT  LEARN-FRON-SINILARITIES 
INSTANCE-OF  6EHERAL I ZAT ION-PROCESS! 


(BUILD-IN  INPUT-5ITUAT10N-PH 

(START-PROBLEM 
((START) I 
--) 

((♦CLEAR-ON  NN  TRIES-NN  CURRENT-CASE-KN  THIS-CASE-NN  BE5T-PERFORHANCE5-NN) 
(♦ADD-TO  TRIES-NN  (♦SET-PRGBLEN) ) 

(♦ADD-TO  TRIES-NN  (FIRST-TRY)  (NOT-ALTESNATIVES-SET)) 

(♦ADD-TO  NN  (NOT-ELIHINATED)  (NOT-CASE-STOFED!  (NQT-PERF-KNONN) !  ) ! 

(SET-NONITORINS-TO-OPTINIZE 
((BOAL  M0NI70RIN6) ) 

--> 

((♦DELETE-FRON  TRIES-NN  (GOAL  MONITORING) ) 

(♦ADD-TO  TRIES-NN  (GOAL  OPTIMIZING!) 

(♦DMTRACE  FULL) 

(♦FNTRACE  FULL))! 

(BO-TO-SATISFY 
((FIRST- TRY)! 

--) 

[(♦CALL  SATISFYINS-PH) 

(♦CONTINUE) ) ! 


) 


(BUILD-IN  SATISrYING-PN 

(SINBLE-HISH-SPEED-TARBET 
l(NB  1)  (NC  0)  (ANN  (B!  =B1)  (B2  =B2)  (Cl  =C1)}> 
— > 

((♦DELETE-FRON  NN  (B1  =B1)  (B2  =82!  (Cl  =Cl!) 
(♦ADD-TO  WH  (El  2)  (B2  8.2)  (CL  !))!) 


(FEN-0THER-TAR6STS 

((NC  =NC!  (NB  8)  (‘GREATER*  =NC  8)  l ‘GREATER*  4  =NCi  (§HN  (C!  =C!>  (C2  =C2 
— > 

((♦DELETE-FRON  NN  (Cl  =CU  (Cl  =C2)! 

(♦ADD-TO  NN  !Ci  2)  (CZ  8.2)!)) 

(HIGH-SPEED-TARGET 
((CURRENT-BEAN  HIGH-SPEED) ) 

— > 

((♦ADO-TO  NN  (Ai  '8.15)  <B1  2)  <32  0.2!  (C;  21  (C2  3.15!)!! 

(DEFAULT-SIT 
((CURRENT-BEAN  DEFAULT)) 

— > 

( (♦AOD-TO  NN  !A2  0.15)  (3!  2)  (B2  0.2!  (Cl  !)  (CZ  0.2!!)! 

(OTHES-SIT 

I (CURRENT-BEAN  OTHER)) 
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((IADD-TO  M  (A2  a. 15)  (B1  2)  IB2  3.2)  (Cl  2)  (C2  0.2!))) 


( F I H I SHED-PI CK 1 N6-F I RST-PARAH-SET 

((IKK  (A2  =A2!  (Bt  =B1)  (B2  =82!  (Cl  =C1)  (C2  =C2)>) 

( (IADD-TO  KM  (FIRST-SET)) 

(IADD-TO  TRIES-HH  (TRY  l=A2  =B1  =B2  =C1  =C2) ) ) ) ) 

(ELIMIHATE-TRIAL-H1SH 

((BUM  (FIRST-SET)  (A2  =A2>  (B2  =32)  (GREATER*  =A2  =92) 
!B1  =B1)  (Cl  =C1)  !C2  =C2)!l 

--> 

((IADD-TO  HM  (ELIMINATED) ! 

(ICELETE-FRGf!  Nil  (N3T-ELININATED) ) 

(IDELETE-FROfl  TRIES-Bfl  (TRY=A2  =B1  =62  =C!  =C2)  >) 
(IADC-TQ  TRIES-Bfi  !TRIED=A2  =Bt  =B2  =Cl  =C2) ) 
(5DELETE-FHOM  Wtt  (FIRST-SET) ) > ) 

(EL I M INATE -TR IfiL-OTHER 

( (SHJ1  (FIRST-SET!  (A2  *A2)  (C2  =C2)  (*5REATER*  =A2  =C2> 
(B:  =B1)  (B2  =52)  (Cl  =C 1 ) ) ) 

— > 

( (IADD-TO  BN  (ELIMINATED)) 

(IDELETE-FROfl  NM  (HOT-ELIMINATED! ) 

(IDELETE-FROfl  TR'ES-BM  !TRY=A2  =B1  =B2  =C1  =C2il! 
(IADD-TO  TP.IES-BH  (TRIEQ=A2  =B1  =B2  =Cl  =C2)1 
(IOELETE-FROH  Nfl  (FIRST-SET!))) 

(ELIHINATE-TRIhL 

((SNH  (FIRST-SET)  (B1  =£1!  (Cl  =C1)  U5REATER*  =C1  =B1! 
(A2  =A2)  (B2  =£2)  !C2  =C2! ) ) 

--> 

( (IADD-TO  m  (ELIMINATED) ) 

(IDELETE-FROfl  Nfl  (NQT-ELININATED) ) 

(IDELETE-FROfl  TRIES-NM  (TRY=A2  =81  =B2  =Cl  =C2))) 
(IADD-TO  TRIES-WM  (TRIED-A2  =B1  =B2  =Ci  =C2) ) 
(IDELETE-FROH  HM  (FIRST-SET)))) 


(FIRST-SET-IN-5ATISFYIN6 
!(SOAL  SATISFYING)  (8«f1  (FIRST-SET))) 
--> 

!  (ICALL  PERFQRMNCE-CHECK-PM) 
(^CONTINUE) ) ) 


(FQR-DPT IMI 2ING-OR-MDNITORINS 
(IBBft  (FIRST-SET!)  (GOAL  OPTIMIZING); 

-> 

( (IADD-TO  TRIE5-BN  (IIDENT5FY-ALTERNATIVE3!) 
(IDELETE-FROH  TRIE5-VH  (NOT-AL'ERHATIVES-SET! i 
(ICALL  PERFORMANCE-CHECK-PH; 

(ICONTINuEi ) ) 


(FOR-LEARHINS 

(•Blrt  (FIRST-SET!)  (GOAL  LEARNING!) 

- ) 

(UAOu-TQ  TRiES-idH  (IIDENT1FY-ALTERNAT IVES) ! 
(IDE-ETE-FRCH  TF IES-MM  IHCT-AL'ERHA- IVES-SET) ) 
(ICALL  PERFORMANCE-CHECK-*)!! 

(icgntihue:)! 
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(BUILD-IN  PERFORHANCE-CHECK-PM 


(CHECK-PERFORMANCE 

( (A2  =A2)  (NOT-PERF-KNONN)  (NGT-ELIN1NATED) 

(81  =Bl)  (B2  *B2)  (Cl  *CU  (C2  =C2) 

(BTRIES-NH  (NA  =NA)  (TRY  (=A2  =B1  =B2  =C1  <2)1 
(NB  =N8)  (NC  =MCi  (FAR  =FAR!)i 

-> 

KTADD-TO  NM  (ICALCULATE-PERFQRMANCE  =NA  =NB  =NC  =AZ  =81  =B2  =C1  =C2  =FAR!) 
(TADD-TQ  NM  (PERF-KNONN) 1 
UDELETE-FROM  NM  (NOT-PERF-KNONN!)  )) 

(STORE-CASE-FOR-LEARNIN6 
( (PERF-KNONN)  (NQT-CASE-ST3RED) 

(A2  =A25  (B1  =B1 )  (B2  =B2)  (Cl  =C1)  (C2  =C2) 

(BTftIES-W(NA  =NA)  (NB  =NB  (NC  =NC!  (CURRENT-BEAM  =B) ) 

(WACO  =NACQ!  (XAC8  =KACG.‘  (YACS  =YAC3!  (ZACS  =ZACB! 

(N3A  =N8Ai  IXBA  =XQA)  (YQA  =Y3A!  (ZQA  =Z9A)  (FARU  =FAR'J!  (OVAM  =QVAH)i 
—  > 

((TADD-TO  CAEE-WM  (<=NA  =NB  =NC  =B)  (=A2  =81  =B2  =C1  =C2! 

(=NAC3  =XACQ  =YAC3  =ZACS  =NSA  =XSA  =YGA  =Z5A  =FAP.U  =QVAH! ! ) 
(fACO-TO  THI3-2A5E-NM  l(=NA  =NB  =NC  =B!  (=A2  =31  =B2  =C1  =C2! 

(=NAC3  =XACO  =YACS  =ZACQ  =HGA  =X8A  =YQA  =Z8A  =FARU  =CVAN) ) ) 

'tADO-TO  CURRENT-CASE-NM  (CONDITIONS  (=MA  -NB  =NC  =E)!) 

ADD-TO  CURRENT-CASE-NM  (SETTINGS  (=A2  =81  =B2  =C1  =C2)!) 
ilASD-TO  CURRENT-CASE-NM  (PERFORMANCES  (=NAC9  =?AC3  =YACS  =ZAC3 

=NBA  =X8A  =Y8A  =ZSA  =FARU  =QVAM)!) 
(tADD-TO  TRIES-WM  (TRIED  !=A2  =B!  =82  =Ci  =C2)!) 

(TDELETE-FSOH  TRIES-NH  (TRY  (=A2  =B!  =B2  *C1  =C2))! 

(TADD-TO  NK  (CASE-STORED)) 

(TOELETE-rRQM  NM  (NOT-CASE-STORED))!) 

(PERFORMANCE-UNACCEPTABLE 

((CASE-STORED I  (PERFORMANCE-BAD)  (BTRIES-NH  (GOAL  SATISFYING))) 

( (TADD-TO  NM  (ELIMINATED)) 

(TDELETE-FP.GN  NM  (PERFORMANCE-BAD)) 

(TDELETE-FROM  NM  (MOT-ELIMINATED! ) ! ! 


(decide-nhat-can-be-tr:ed 

((ELIMINATED)  (BTRIES-NM  (FIRST-TRY!  (GOAL  SATISFYING!  (NOT-ALTERNATIVES-SET) I 
—  ) 

(UOELETE-FROM  TRIES-NM  !FIRST-TRY:i 
(TADD-TQ  TRIES-WM  tNQT-FIRST-TRY) ) 

(TADD-TO  TRIES-WM  (TIDENTIFY-ALTERNATIVES) ! 

(TOELETE-FRCM  TRIES-WM  (NOT-ALTERNATIVES-SET)) 

)) 


(REMOVE-SET-TRIED-FIRST 

KBTRIES-NM  (GOAL  SATISFYING)  (TRIED  =PARANS)  (TRY  =PARAMS; I ) 
--) 

( (TDE.ETE-FRQM  TRIES-WM  (TRY  =PARAMS) ) 

I) 
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(6ET-NEN-TRIAL 

((ELIMINATED) 

(6TRIES-NM  (TRY  =PARANSI  (NQT-FIRST-TRY) >  ) 

--> 

( (ICLEAR-DN  ON) 

(IADD-TO  NN  (NOT-ELIMINATED)  (NOT-CASE-STORED)  (NQT-PERF-KNONN) ) 
(♦ADD-TQ  m  (IGET-NEXT-TRY  =P ARABS)! 

(♦OELETE-FRON  TRIES-NN  (TRY  =PARANS))!) 

(FINISHED-SATISFYING 

((CASE-STORED!  (PERFORNANCE-OK)  (BTRIES-Nil  (EOAL  SATISFYING!!) 

--> 

((IHRITE  'm**THE  PARAMETERS  FOR:  *! 

(♦PRINT-FIRSTS  TRIES-HM  CURRENT-BEAN  NA  NB  NC) 

(INRITE  *»*ARE:  ■) 

(♦PRINT-FIRSTS  NN  A2  B1  B2  Ci  C2! 

(INRITE  ‘♦♦WITH  PERFORMANCE  VALUES;  ■) 

(♦PRINT-FIRSTS  NN  FARU  NAC3  (ACS  YACS  ZACS  NBA  ISA  YQA  Z6A  QVAN! 
(ICLEAR-DN  NN  TRIES-NN) 

(IADD-TO  TRIES-NN  (START)) 

(ICALL  INPUT-SITUATION-??!) 

(♦CONTINUE! I) 


(FIRST-OPTIN1IING-TRY 

((CASE-STORED!  (87R1ES-NH  (GOAL  OPTIMIZING)) 

(8TRIES-NH  (FIRST-TRY!)  (OVA«=OVAM)! 

- / 

((♦UELETE-FRDM  TRIES-NN  (FIRST-TRY!) 

(♦ADD-TQ  TRIES-NN  (NOT-FIRST-TRY!) 

(ICLEAR-DN  BEST-PERFORNANCES-NN! 

(IADD-TO  BEST-PERFORNANCES-NN  (QVAN  =0VAN)) 

(♦NRITECR  •♦♦♦♦♦THE  PARAMETERS  FOR:  *) 

(♦PRINT-FIRSTS  TRIES-NN  CURRENT-BEAN  NA  NB  NC) 

(♦NRITECR  *»ARE:  ■) 

(♦PRINT-FIRSTS  NN  A2  8t  B2  Cl  C2! 

(♦NRITECR  ‘♦♦NITH  PERFORMANCE  VALUES:  ’) 

(♦PRINT-FIRSTS  NN  WACQ  IACQ  YACS  ZACS  NSA  ISA  YBA  ZEA  FARU  DVAM) 
(♦CALL  TRY-ANYTHING-PN) 

(♦CONTINUE) 

)) 


(CHECK-F0R-0VERALL-BE5T-50-FAR 
((CASE-STORED)  (BTRIES-NN  (GOAL  OPTIMIZING;! 
(•BEST-PERFORNANCES-NN  (OVAN  =ECVAN!) 

(CVAN  =OVAM) 

(♦GREATER*  =53VAM  =OVAN!) 

/ 

( (ICLEAR-DN  BEST-PERFORNANCES-NN! 

(IPOD-’Q  3EST-PESFCFNANCES-NH  (CVAN  =GVAN)! 

(♦NRITECR  PARANETER;  FOR:  *) 

(IFRINT-FIRST:  TRIES-NN  CURRENT-BEAN  NA  NS  NO 
(INRITECR  “♦♦ARE:  ■) 

(♦5RiNT-FIP.STS  NN  A"  8)  B2  Ci  C2! 

(♦NRITECR  '♦♦WITH  PERFORMANCE  VALUES:  •) 

!ICRINT-FIRSTS  NN  WACQ  IACQ  YACS  ZACS  NBA  IQa  YQA  Z^A  FARU  OVAN) 
(♦CALL  TRY-ANYTKING-RN) 

(♦CONTINUEi 

)) 
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(BUILD-IN  TR Y-AHYTH I N6-PH 


(TRY-ANYTHIN6-N0T-TRIED 
((TRY  *PARAWS ) ) 

— > 

((♦CLEAR-ON  NH) 

<$ADD-TO  NN  (HOT-ELIMINATED)  (NQT-CASE-STQRED!  (NOT-PERF-KNONN) 
(♦GET-NEXT-TRY  -PARANSl) 

(♦CALL  PERFDRKANCt-CHECK-PH) 

(♦CONTINUE))) 


) 


(BUILD-IN  LEARNING-PM 


(COUNT-POINTS 

(18CASE-NM  (=PERFS1?  (=PERFS2!  (»«OT  (*EQUAL  =PERF31  =PERcS2!)i) 
— ) 

((♦ADD-TO  LEARN-Wfl  (♦COUNT-PNTS  (=?ERFS1  =PERFS2> )  > ) ) 
(COMPARE-CASES 

((RELATION  =REL  BEST  ^PARAMETERS) ) 

--> 

((♦BUILD-IN  SATISFYIN6-PM 

(=NEN-?RCD-NAME  ( (=REL) )  -->  ((/♦ADD-TO  NM  (PARAMETERS)?))) 
(♦DELETE-FROM  LEARN-XM  *1)1) 


) 


(ADD-TO  TRIES-NH  (START)) 
(CALL  INPUT-SITUATION-PH) 


(DtXPR  GET-PROBLEM  (!  (PROS  (PROBLEM  PROB  RESULT  SQAL  CURRENT-BEAN  NA  NB  NC  FAR) 
(PRINK  'TYPE  A  PROBLEM  (OR  0  TO  SUIT):  M 
(SETS  PROB  (CAR  (INPUT-LINE!)) 

(COND  ((EQUAL  PROB  'B)  (HALT)  (RETURN  NIL!!) 

(SETS  SOAL  ■SATISFYING! 

(SETS  CURRENT-BEAM  'DEFAULT! 

(SETS  NA  36) 

(SET3  NB  3) 

(SETQ  NC  0) 

(SETB  FAR  7.21 


LOOP  (SETQ  PROBLEM  PROB! 

(CONE  (<E9  (CAAR  PROBLEM! 
((EQ  (CAAR  PROBLEM) 
(<EQ  (CAAR  PROBLEM) 
('.EQ  (CAAR  PROBLEM! 


'GOAL)  (SETQ  GOAL  (CADAR  PROBLEM!)! 
'NA!  (SETQ  NA  (CADAR  PROBLEM))! 

'MBS  (SETB  NB  (CADAR  PROBLEM)!) 

’NC!  (SETS  NC  (CABAR  PROBLEM! !) 


KEfl  (CAAR  PRQ3LEM!  ‘CURRENT-BEAM!  (SETQ  CURRENT-BEAM  'CADAR  PROBLEM))! 
((Efi  (CAAR  PROBLEM!  'FAR!  (SETS  FAR  (CADAR  PROBLEM))) 

(T  (URITECR  *t««ENTER  PROBLEM  IN  SPECIFIED  FORMAT****# ’) 


(PRINK  ‘TYPE  A  PROBLEM  (OR  Q  TO  QUIT):  ■) 

(SETQ  PROB  (CAR  (INPUT-LINE))! 

(COND  ((EQUAL  PROB  '8!  (HALT)  (RETURN  NIL)!)  F-7 
(SETQ  SOAL  ’SATISFYING! 
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(SETS  CURRENT-BEAN  ‘DEFAULT) 

(SETS  NA  36) 

(SETS  NB  0) 

(SETS  NC  8) 

(SETS  FAR  7.21  ))  ) 

(SETS  PROS  (CDR  PROBLEM) ) 

(CONO  ((NOT  (NULL  PROS))  (SO  LOOP))  ) 

(COHO  ((NOT  (ESP  (PLUS  NA  NB  NC!  36)) 

((NRITECR  *»*«THE  SUN  OF  NA,  NB,  AND  NC  MUST  3E  36.««'l 
(PRINK  ‘TYPE  A  PROBLEM  (OR  6  TO  QUIT):  *) 

(SETS  PROB  (CAR  (INPUT-LINE))! 

(CONO  ( (EQUAL  PROB  ‘8)  (HALT)  (RETURN  NIL!!) 

(SETS  SOAL  ‘SAT1SFYIN61 
(SETS  CURRENT-BEAN  ‘DEFAULT) 

(SETS  NA  36) 

(SETS  NB  8! 

(SETS  NC  8) 

(SETS  FAR  7.2) 

160  LOOP!  !) 

((NOT  (OR  (ES  GOAL  ‘SATISFYING! 

(EQ  SOAL  ’OPTIMIZING) 

(ES  SOAL  ‘LEARNING) 

(EG  60AL  'MONITORING!)) 

((NRITECR  'fMGOAL  MUST  BE  SATISFYING,  OPTIMIZING,  LEARNING,  OR  MONITORING.***') 
(PRINK  “TYPE  A  PROBLEM  (OR  9  TO  QUIT):  ') 

(SETS  PROB  (CAR  (INPUT-LINE))) 

(COND  ( (EQUAL  PR03  B)  (HALT)  (RETURN  NIL))) 

(SETS  GOAL  ‘SATISFYING! 

(SETS  CURRENT-BEAM  ‘DEFAULT) 

(SETS  NA  36) 

(SETS  NE  8) 

(SETS  NC  8) 

(SETS  FAR  7.2) 

(GO  LOOP)  )) 

((NOT  (OR  (ES  CURRENT-BEAM  ‘HIGH-SPEED! 

(ES  CURRENT-BEAM  'DEFAULT) 

(ES  CURRENT-BEAM  'OTHER!!) 

( (NRITECR  “***CURRE?IT-8EAM  MUST  BE  HIGH-SPEED,  DEFAULT  OR  OTHER.***") 

(PRINK  ’TYPE  A  PROBLEM  (OR  S  TO  SUIT):  ■) 

(SETQ  PROB  (CAR  (INPUT-LINE:)) 

(CCND  ! (EQUAL  PROB  ‘8)  (HALT!  (RETURN  NIL)!! 

(SETQ  GOAL  ’SATISFYING) 

(SETS  CURRENT-BEAM  ‘DEFAULT! 

(SETQ  NA  16) 

(SETS  NB  0) 

(SETQ  NC  B) 

(SETQ  FAR  7.2! 

(SO  LOO?!))  ) 


(PRISM: RUSH  (LIST  ‘60AL  GOAL)  RESULT) 

(PRISM: PUSH  (LIST  ‘NA  NA!  RESULT) 

(PhIRMiPUSH  (LIST  'NB  NB)  RESULT) 

(PRISM: PUSH  (LIST  ‘NC  NC!  RESULT) 

(PRISM; PUSH  (LIST  'CURRENT-BEAM  CURRENT-BEAM)  RESULT) 
(PRISM; PUSH  (LIST  ‘FAR  FAR)  RESULT i 
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(RETURN  RESULT))) 


(DEXPR  6REATER*  U  Y) 

(AND  (NUHBERP  X)  (NUHBERP  Y)  (6REATERP  X  Y))) 


(DEXPR  IDEMT IFY-ALTERNAT I VES  () 

(PROS  (RESULT  ALTER, NS  ALT) 

(SET8Q  ALTERNS  ((9.1  1  9.1  1  0.1)  (9.1  1  0.1  1  0.15)  (9.1  l  9.1  1  0.2) 

(9.1  1  9.15  1  9.1!  (0.1  1  9.15  1  0.15)  (0.1  1  9.15  1  9.2! 

(8.1  1  9.2  1  9.1!  (0.1  1  0.2  1  0.15)  (9.1  1  0.2  1  9.2) 

(9.1  2  9.1  1  9.1)  (9.1  2  9.1  1  9.15)  (9.1  2  0.1  1  9.2) 

(9.1  2  9.15  1  9.1)  (0.1  2  0.15  1  0.15)  (0.1  2  9.15  1  0.2) 
(0.1  2  9.2  1  0.1!  (9.1  2  0.2  1  0.15)  (0.1  2  0.2  1  0.2) 

(9.1  2  9.1  2  9.1!  (0.1  2  3.1  2  0.15!  (9.1  2  8.1  2  0.2) 

(9.1  2  0.15  2  0.1)  (8.1  2  0.15  2  3.15)  (8.1  2  0.15  2  0.2) 

(9.1  2  3.2  2  0.1)  (9.1  2  8.2  2  0.15)  (0.1  2  9.2  2  0.2) 

(0.15  1  0.15  1  9.15)  (0.15  1  0.15  1  3.2! 

(0.15  l  0.2  1  0.15!  (8.15  1  8.2  1  0.2) 

(0.15  2  3.15  1  9,15)  (0.15  2  8,15  1  0.2) 

(0.15  2  3.2  1  9.15!  (0,15  2  0.2  1  0.2! 

(0.15  2  0.15  2  0.15)  (0.15  2  0. !5  2  0.2) 

(0.15  2  8.2  2  9.15!  (0.15  2  0.2  2  0.2! 

(0.2  1  2,2  1  9.2!  (0.2  2  0,2  1  0.2)  (0.2  2  8.2  2  0.2!!  ) 
(SETC  ALT  ALTERNS! 


LOOP  (PRISM: PUSH  (LIST  'TRY  (CAR  ALT!!  RESULT) 

(COND  ((NOT  (NULL  (COR  ALT!)!  (SETS  ALT  (COR  ALT)) 

(60  LOOP!)! 

(PRISH: PUSH  ' (ALTERNATIVES-SET)  RESULT) 

(RETURN  RESULT) ) ) 

(DEXFfi  C0UNT-PNT5  (XI  X2) 

(PROS  (RESULT  SIT  SETS  PERFS  PERFSN 
XSI  XSET3  XPERF3 
NA  NE  NC  BEAN 
XNA  XN9  XNC  XBEAfl 
A2  91  B2  Cl  C2  FARU 

XA2  XB!  XP2  XC1  XC2  XFARU 
MACS  XACS  YAC3  ZACS  NAS  XA8  YA9  2A0  QVAN 
XNACQ  XXACS  XYAC3  XZAC8 
XNAG  XXAS  XYAS  XZA8  IGVAH 

NAX-NACS  NAX-XAC3  NAX-YAC3  NAX-ZACS  ilAX-NGA  NAX-X3A  NAX-YBA  NAX-Z3A 
RELNA  RELNB  RELNC! 


(SETS  SIT  (CAR  XI) ) 

(SETS  SETS  (CADR  ID) 

(SETS  PERFS  (CAOOR  XI) ! 

(SETS  XSIT  (CAR  X2D 
(SET8  ISE’S  (CADR  X2!) 

XSET0  XPERFa  (CAOOR  X2I) 

(COND  UE3UAL  PERFS  XPERFS! 

(COND  ( (6REATEP.P  NA  XNA; 

(PMSfcPUSH  (LIST  'S3AN  (LIST  'NA  XNA  NAD  RESULT)) 
((SREATERP  XNA  NA) 

(PRISM: PUSH  (LIST  'SPAN  (LIST  'NA  NA  XNA))  RESULT!)  ) 
(COND  ((GREATLRP  NB  XNB! 
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<PRISH:PUSH  (LIST  'SPAN  (LIST  'NB  XNB  NBIl  RESULT)) 

((6REATERP  XNB  NB) 

(PRISHiPUSH  (LIST  'SPAN  (LIST  'NB  NB  INB1)  RESULT) I  ) 

(COND  ((6REATERP  NC  XNC) 

(PRESHsPUSH  (LIST  'SPAN  (LIST  'NC  XNC  NC)I  RESULT)) 

((6REATERP  XNC  NC) 

IPRISHjPUSH  (LIST  'SPAN  (LIST  'NC  NC  XNC))  RESULT))  ) 

(RETURN  RESULT)  )) 

(SETS  NA  (CAR  SIT)) 

(SETS  NB  (CADR  SIT)) 

(SETS  NC  (CAOOR  SIT!) 

(SETS  A2  (CAR  SETS)) 

(SETS  31  (CADR  SETS) ) 

(SETS  B2  (CADDR  SETS)! 

(SETS  Cl  (CADDDR  SETS)! 

(SETS  C2  (CADDDDR  SETS!) 

(SETS  OVfltl  (FLAST  PEHFS)) 

(SETS  XNA  (CAR  XSIT!) 

(SETS  XNB  (CADR  XSIT!) 

(SETS  XNC  (CADDR  XSIT)! 

(SETS  XA2  (CAR  XSETSI) 

(SETS  XB1  (CADR  XSETS) ) 

(SETS  XB2  (CADDR  XSETS!) 

(SETS  XC1  (CADDDR  XSETS)) 

(SETS  XC2  (CADDDDR  XSETS)) 

(SETS  XGVAfl  (FLAST  XFERFS! ) 

(SETS  BEAN  (CADDDR  SIT? ) 

(SETQ  XBEAN  (CADDDR  XSIT!) 

(SETS  SAGS  (CAR  PERFS!) 

(SETS  XAC8  (CADR  PERFSI) 

(SETS  VACS  (CADDR  PERFS! ) 

(SETS  ZACS  (CADDDR  PERFS! ! 

(SETS  PERFS, 1  (CDDDDR  PERFS!) 

(SETS  NAQ  (CAR  PERFSN) ) 

(SETQ  XA9  (CADR  PERFSN) > 

(SETQ  YA9  (CADDR  PERFSN)  I 
(SETS  ZAQ  (CADDDR  PERFSN) ) 

(SETS  NAX-NACS  125)  (SETS  NAX-XAC3  125)  (SET3  NAX-YAC3  1251  (SETS 
NfiX-ZACQ  1251 

(SETQ  NAX-N8A  133!  (SETS  NAX-XDA  130)  (SETQ  NAX-YQA  133!  (SETS  NAX-IQA  103! 

(SETS  OK  (AND  (LESSP  NACQ  NA1-NACS! 

(LESS?  XACQ  NAX-XACQ) 

(LESSP  YACfi  NAX-YACS) 

(LESSP  ZACS  NAX-ZACQ) 

(LESSP  NQA  NAX-N8A) 

(LESS?  X3A  NAX-XSA) 

(LESSP  YQA  NAX-YSAI 
(LESSP  ZQA  NAX-Z3A!)) 
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(SETA  PERFSN  (COBDBR  PERFSN)) 

(SETA  FRAU  (CAR  PERFSN) 1 

(SETA  XHAC8  (CAR  XPERFS)) 

(SE'A  HACA  (CADR  IPERFS) ) 

(SETA  IYACA  (CADDR  IPERFS)) 

(SETA  IZACA  (CADDDR  IPERFS! ) 

(SETA  PERFSN  (CDDDDR  IPERFS)) 

(SETA  im  (CAR  PERFSN!) 

(SETA  HAS  (CADR  PERFSN) ) 

(SETS  XYAS  (CADDR  PERFSN) ) 

(SETA  IZAS  (CADDDR  PERFSN!) 

(SETfl  IOK  (AND  (LESS?  INAC3  KAX-NAC9) 
(LESS?  JIAC3  BAX- MCA) 
(LESS?  XYAC3  NAX-YACQ! 
(LESSP  XZAC9  NSX-ZACG) 
(LESSP  I'ABA  NAX-NBA; 
(LESSP  I  IGA  NAX-XGA) 
(LESS?  XY3A  KAX-YQA! 
(LESS?  XZSA  BAX-ZEA) ! ) 

(S-T3  ?E.RFSN  (CDDDDR  PSRFENM 
(SE *3  XFARU  (CAR  PERFSN!  i 


(COHO  KNOT  (E3UAL  S'.T  XSITM 
(CONG  !  (GREATER?  NA  XNAi 

(COSO  ((GREATER?  XGVAN  OVAN) 

(PR(5H:?USH  (LIST  (LIST  'RELATION  (LIST  '(NA  *RA)  (LIST  '»6REA?SRP  '=NA  XNA) )  )  (LIST  'BEST  (LIST  'A2  A2! 
(LIST  'B1  BO  (LIST  'B2  52)  (LIST  XI  CD  (LIST  X!  C2)l)  RESULT)) 

((GREATER?  OVAN  XOVAN) 

(PR!SN:?USH  (LIST  (LIST  'RELATION  (LIST  -(NA  *Bfll  (LIST  '«LESS?  '=NA  (PLUS  XNA  DM  )  (LIST  ’BEST  (LIS' 

2  XA2>  (LIST  'B1  Is!)  (LIST  '52  XB2)  (LIST  X!  XCD  (LIST  'C2  XC2!!!  RESULT): 

(T  (PRISfi: PUSH  (LIST  'SPAN  (LIST  'NA  XNA  NA')  RESULT!!:) 


( (5REATERP  XNA  NA! 

(COND  ( .GREATER?  O', 'AN  XOVAN) 

(PRISNiPUSH  (LIST  (LIST  RELATION  !LIST  '  (NA  =NA)  (LIST  '♦5REATEP.P  '  =NA  NAM  )  (LIST  'BEST  (LIST  •&; 

(LIST  ’i;  JED  (LIST  'B2  XB2)  (LIST  'Cl  XCD  (LIST  'C2  XC2M)  RESUL' ' ' 

((GREATER?  XOVAN  OVAN! 

(FRISN-.P'JSH  (LIST  (LIST  'RELATION  (LIST  ' (NA  =SAi  (LIST  'iLESS?  '=NA  (PLUS  NA  IMS  )  (LIST  'BEST  (LIST  '  = 
A2i  (LIST  'Si  ED  (LIST  '62  BE!  (LIST  'Cl  CD  (LIST  -C2  C2M  )  RESULT): 

(I  (PRI3N:?USN  (LIST  'SPAN  •.LIST  'NANA  SNA!)  RESULT!))  I 


XOND  ((GREATS-0  NE  XNB) 

(CONG  ((GREATE.RP  XOVAN  OVAN! 

(PSISHsP'JSH  (LIST  (LIST  'RELATION  (LIST  ' (KB  =NB)  (LIST  '16SEATERP  '=N6  XNBi i  )  (LIST  'BEST  (LIS'  'A2  12! 
(LIST  '3;  gi)  ;t_IST  'B2  B2:  (LIST  XI  CD  (LIST  X2  C2M!  RESULT)) 

((GREATER?  OVAN  XOVAN! 

(rRiS.X:?'JS-  (LIST  (LIST  'RE.A'ION  (LIST  ' (N5  =NS'-  (LIST  '«LE5S?  '*S3  (PLUS  XNS  111!  )  (LIS’  'BEST  (LIS"  ' 
2  XS2i  (LIST  '31  IB!)  (LIST  B2  XB2)  (US'  XI  XCD  (LIST  X2  XCGi)i  RESOLD) 

(T  (PR  I  SIX:  PUSH  (LIS’  SPAN  '.LIST  N?  XNB  NBI)  RESOLD  M) 

KEREATERP  XNB  NE; 

(COHO  ((GREATER?  OVAN  XOVAN) 
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(PRISM: PUSH  (LIST  (LIST  'RELATION  (LIST  ' (MB  »NB)  (LIST  **6«EflTERP  '»NB  NB))  )  (LIST  "BEST  (LIST  **2  XA2I 
(LIST  'B1  IB1)  (LIST  'B2  IB2)  (LIST  'Cl  ICU  (LIST  'C2  IC2D  )  RESULT)) 

(16REATERP  IOVAH  OVflh) 

(PRISM: PUSH  (LIST  (LIST  'RELATION  (LIST  ' (KB  =NB)  (LIST  '*LESSP  '*NB  (PLUS  NB  1)))  )  (LIST  'BEST  (LIST  'A2 
A2)  (LIST  ' 8 1  Bl)  (LIST  '82  82)  (LIST  'Cl  Cl)  (LIST  'C2  C2I)  )  RESULT)) 

(T  (PRISM: PUSH  (LIST  'SPAN  (LIST  'NB  NB  INB))  RESULT))!) 

) 

(COND  ( (6REATERP  NC  INC) 

(COND  ((SREATERP  IOVAH  OVAM) 

(PRISM: PUSH  (LIST  (LIST  'RELATIO  (LIST  '(NC  =NC)  (LIST  '*6REATESP  '=NC  INC))  )  (LIST  'BEST  (LIST  'A2  A2) 
(LIST  'Bl  Bl)  (LIST  'B2  B2)  (LIST  C!  Cl)  (LIST  'C2  C21)  !  RESULT)) 

((6REATERP  OVAM  XOVAH) 

(PR!SM:PUSH  (LIST  (LIST  'RELATION  (LIST  '(NC  =NC)  (LIST  '*LESSP  '=NC  (PLUS  INC  1)1)  )  (LIST  'BEST  (LIST  'A 
2  XA2)  (LIST  'Bl  IBli  (LIST  '82  IE2)  (LIST  'Cl  IC1)  (LIST  'C2  XC2!)  )  RESULT)! 

(T  (PRISM: PUSH  (LIST  'SPAN  (LIST  'NC  INC  NO)  RESULT!))) 


((GREATEXP  INC  NC! 

(COND  !  (GREATER?  OVAM  IOVAH) 

(PRISM: PUSH  (LIST  (LIST  'RELflTIGN  (LIST  '(NC  =KCi  (LIS'  ’*6REATER?  '=NC  NC! )  !  (LIST  'BEST  (LIST  'A2  XA2! 
(LIST  'Bl  IB!)  ILIST  'B2  IB2i  (LIST  ’Cl  IC!)  (LIST  'C2  XC2:i  )  RESULT)) 

( (GREATER?  XQVAM  OVAM) 

(PR!3H:?USH  (LIST  (LIST  ‘RELATION  (LIST  ' (NC  =NC)  (LIST  '»LESSP  =MC  (PLUS  NC  ID)  )  (LIST  'BEST  (LIS'  -A2 
A2)  (LIST  '31  Bli  (LIST  ’52  32)  (LIST  'Cl  CD  (LIST  'C2  C2D  )  RESULT)) 

(T  (PRISM: PUSH  (LIST  'SPAN  (LIST  'NC  NC  INC:)  RESULT)))) 

)  ) 


(T  (COMO  ( (AND  OK  (NOT  KOKH  (PRiSH:PUSH  (LIST  'IN-SITUATION  SIT 

SETS  'BETTER-THAN  XSETS)  RESULT)) 
((AMD  XOK  (NOT  OK!)  (PRISM: PUSH  (LIST  'lN-SiTUATION  SIT 

XSETS  'BETTER-THAN  SETS)  RESULT))) 
(COND  ! (GREATER?  OVAM  IOVAH)  (PRISM-.PUSH  (LIST  'IN-SITUATION  SIT 


)) 


1 (GREATERP  IOVAH  OVAM) 


XSETS  'BETTER-THAN  SETS)  RESULT)) 
IPS ISM: PUSH  (LIST  'IN-SITUATION  SIT 
SETS  'BETTER-THAN  XSETS)  RESULT))! 


(DEXP3  CALCULATE-PEAFQRMANCE  (NA  NB  NC  A2  Bl  B2  Cl  C2  FAR! 

(FROG  (RESULT  FARU  WACO  IACS  YACQ  ZACS  NA3  IAS  YA3  ZA3  OVAM  ST 

f!  P2  DPCNA  OPCIA  DPCYA  DPCZA  ?9!  PS2  P33  PSA  DPCNO  OPCXQ  DPCYS  DPCZ3 
HAI-NAC3  MAMA.CQ  MAX-YACS  MAX-ZACS  HAI-N8A  HAI-ISA  MAX-YSA  HAI-ZSPl 

(EE'S  MAX-WC5  125)  (SETS  MAX -IACS  125;  (SETS  HAX-YACS  125!  (SETS  HAX-ZAC9  125! 

(SETQ  MAX-NQA  180)  (SETS  HAX-XSA  IBB;  (SETS  HAX-YSA  IBB)  (SETS  MAX-ZQA  IBB) 

(SETS  3T  (FPLUS  (FUMES  A2  NA)  (FT1MES  Bl  52  NB)  (FUMES  Cl  "2  NC!)) 

(COND  ! (E2?  A2  8,1)  (SETQ  PI  8.13i5)  (SE'S  P2  8. 64561! 

!  T  (SETQ  Pi  3.644'!  (SETS  ?2  0.9921) !  ) 

(SE’S  DCCNA  (FSUOTIENT  (FTIMES  PI  2,?!*)  57)1 

(SE'S  OPCIA  (F3UOTIENT  (FTIMES  P2  2.914)  STD 

(SETS  DPCYA  (FOUOTIENT  (FTIMES  PI  7.258)  STD 

(SE'S  OPCZA  (FSUO-IENT  (FTIMES  P2  7.250!  STM 
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(COND  ((EBP  62  0.1)  (SETS  PB1  0.13451  (SETS  PB2  0.4456)) 

(  T  (SETS  PQi  0.6443)  (SETS  PQ2  0.99211)  ) 

(COND  ((EBP  82  0.15)  (SETA  PQI  0.38417)  (SE76  PQ2  0.93148)) 

(  r  (SETS  P81  0.6443!  (SETS  PQ2  0.992!  )>  I 

(SETS  0PCH6  (FQUQTIENT  (FUSES  P91  2.914  Bl)  STil 

(SET9  OPCXQ  (FQUQTIENT  (FTIKES  P92  2.914  Bl)  ST) I 

(COND  ((ESP  C2  0.1)  (SETS  PS3  0.1365)  (SETS  PS4  0.4456)) 

(  T  (SETS  P93  0.6443)  (SETS  P94  0.9921))  ) 

(COND  ( (ESP  C2  0.15)  ISETQ  P83  0.38417)  (SETS  PQ4  0.93148) ) 

(  T  (SETS  PQ3  0.6443  )  (SETS  PQ4  0.9921  ))  I 

(SETS  DPCYQ  (F9U0TIENT  (FTIKES  PQI  7.25B  Cl)  ST!) 

(SETS  DPCZQ  (F9U0TIENT  (FT IME5  P84  7.258  Cl)  ST)) 

(COND  ((6REATERP  DPCHA  !)  (SETS  MACS  (FNKL  DPCWfi) i ! 

(  T  (SETS  MACS  (FNK  DPCKA! ! )  ) 

(COND  ( !8R.EATERP  DPCXA  !!  (SETS  XAC2  (FNKL  DrCXfti ) ! 

(  T  <SE*3  XA.C3  (FNK  DPCXA)!)  ) 

(COND  !  (GREATER?  DPC'.'A  1)  (SETS  VACS  (FNKL  DPCVAI!) 

(  T  (SET9  YAC3  (FNK  DPCYA! ) !  ) 

(COND  ((SREATERP  DPCZA  1)  (SETS  ZACS  (FNKL  DFCZA))! 

(  T  (SETQ  ZACS  (FNK'  DPCZA))!  ) 

(COND  ((ZEROP  N8i  (SETQ  «QA  0)  (SETQ  ISA  01) 

(T  (COND  ((GREATERP  OPCNG  11  (SETS  NO A  (FNKL  DPCNQ! ) ) 

(  T  (SETS  MQA  (FNK  DFCV4B' ) )  ) 

(COND  ((GREATER?  OPCXQ  1)  (SETQ  XQA  (FNKL  OPCXQ!)) 

(  T  (SETQ  XGA  (FNK  DPCXSD)  )  I! 

(CONO  ((ZEROP  NC!  (SETS  YQA  0)  (SETS  ZQA  0!) 

(T  (COND  < (GREATER?  DPCYQ  1)  (SETS  YGA  (FNKL  DPCY6! ) ) 

(  T  (SETQ  YQA  (FNK  DPCYQ)))  ! 

(COND  ((GREATER?  DPCZQ  1)  (SETQ  ZQA  (FNKL  DPCZQ))) 

(  T  (SETQ  ZQA  (FNK  DPCZQ) ) )  )  !! 


(SETQ  FARU  9.9961 


(SETQ  QVAK  (FPLUS  FARU  (FTIKES  0.25  (FPLU5  XACQ  XACS  VACS  ZAC8)! 
MSA  XQA  YQA  ZQA! ) 


(PRISK:PUSH  (LIST  'FAR'J  FARU)  RESULT! 

(FRISK: PUSH  (LIST  '0AC9  MACSi  RESULT) 

(PRISM: PUSH  (LIS*  'XACS  XAC8!  RESULT) 

(FRISK: PUSH  (LIST  'YACS  YACQ)  RESUL”) 

(FRISK: PUSH  (LIST  'ZACS  ZACQ)  RESULT! 

(PRISM: °USH  (LIST  MCA  MCA!  RESULT/ 

(PRISM: PUSH  (LIST  'XQA  ISA)  RESULT! 

(PRISK:PUSH  (LIST  'YQA  YQA)  RESULT) 

(PRISM: PUSH  (LIST  'ZQf  ZQA)  RESUL'I 

(FRISK: PUSH  (LIST  'QVAK  3VAK1  RESULT 

(COND  ('.AND  (LESS?  WAC9  KAX-HAC3) 
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(LESSP  XAC3  HAX-XACQ) 

(LESSP  YACQ  MAX-YAC8) 

(LESSP  ZACS  HAX-ZAC8} 

(LESSP  MSA  HAX-XQA) 

(LESSP  XQA  HAX-X8A) 

(LESSP  Y9A  HAX-YBA) 

(LESSP  ZSA  MAX-28A) )  (PRISH:?USH  ' (PERFQRMANCE-OK)  RESULT) 1 
(T  (PRIEfl: PUSH  ' (PERFORMANCE-BAD)  RESULT))) 


(RETURN  RESULT) 


CDEXPS  FNM  (U)  (FTiNES  172  (ANTIL05  (FTINES  U  -3.52i36)!.M 

(DEXFR  FXML  (U)  (FTINES  9.55  (ANTILOS  (FTINES  U  -8.5365)))) 

(SEXPR  SET-NEXT-TRY  (PARAMSi 
(FSQS  (RESULT) 

(PRISM: PUSH  (LIST  'A2  (CAP.  PARAMS!)  RESULT! 

(PRISM: PUSH  (LIST  'B!  (CADR  PARAMS)!  RESULT) 

(PRISM: PUSH  (LIST  '32  (CADOR  PARAMSi)  RESULT) 

(PRISM: PUSH  (LIST  'Cl  (CADSR  {COR  PARAMSi!)  RESULT) 
(PRISM: PUSH  (LIST  'C2  (CADSR  (CDDR  PARAMSi!)  RESULT! 
(RETURN  RESULT)  !! 


STOP 

7KDEFAULTF0NT  1  (6ACHA  18)  (SACHA  5!  (TERMINAL  8!) 
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APPENDIX  G 

Log  of  a  Session  Running  the  Learning  Program, 

DISCRIM 
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LOG  OF  A  SESSION  RUNNING  THE  LEARNING 
PROGRAM.  DISCRIM 


Listing  a-f  File  {FLOPPY! DISC. LOG  ,  3-Nov-B7  12:06«16  by 


lit-  (CLEAR-ALL) 

CLEAR-ALL  OLD-CASE-WM: 

CLEAR- ALL  CAND IDATE-RELATIQNS-WM: 

CLEAR-ALL  LEARN-WM: 

CLEAR-ALL  TRIES-WM: 

CLEAR-ALL  BEST -PERFORM ANCES-WM; 

CLEAR-ALL  TH I S-CASE-MM : 

CLEAR-ALL  CASE-UM: 

CLEAR-ALL  F'REV  IGU5-C  ASE-WM : 

CLEAR-ALL  CURRENT -C ASE-WM: 

CLEAR-ALL  WM: 

CLEAR-ALL  LEARNING-PM: 

CLEAR- ALL  INPUT-SITUATiON-PM: 

CLEAR-ALL  TRY-ANY THING -F'M: 

CLEAR -ALL  PERFORMANCE-CHECK -PM: 

CLEAR-ALL  SATISFYING-PM: 

CLEAR-ALL  PM: 

NIL 

12-t—  (PLOAD  DI3CRIM) 

< DSKX  L I SPF I LES  > D I SCR  I M . ; 10 

BUILDING  ST  ART-F'RQ9LEM 
BUILDING  SET-MONITORING-TQ-OPT IM  HE 
BUILDING  GO-TG-SATISFY 
BUILDING  SINGLE-HIGH-SPEED-TARGET 
BUILDING  FEW-OTHER-TARGETS 
BUILDING  HIGH-SPEED-TARGET 
BUILDING  DEFAULT-SIT 
BUILDING  OTHER-SIT 

BUILDING  FINISHED-PICKING -FIRST-FAR AM- SET 
BUILDING  ELIMINATE -TRIAL-HIGH 
BUILDING  EL  IMINATE-T3I AL-07HER 
BUILDING  ELIMINATE-TRIAL 
BUILDING  FIRST-SET- IN- SAT  I  SPYING 
BUILDING  FOR-OPTIMI ZING-OR-M0NITQRING 
BUILDING  FOR-LEARNING 
BUILDING  CHECK-PERFORMANCE 
BUILDING  STORE-CASE-FOR-LEARNING 
BUILDING  PERFORMANCE-UNACCEPTABLE 
BUILDING  DEC 1DE-WHAT-CAN- BE- TRIED 
BUILD  I  NS  REMOVE -SET -TRIED-FIRST 
BUILDING  GET-NEW-TRIAL 
BU I L  D I N  G  FIN  I  SHED-SAT ISFY I NG 
BUILDING  FIRST  — OPTIMIZING  —  TRY 
BUILDING  CHECK-FOR-OVERALL-BEST-SO-FAR 
BUILDING  TRY-ANYTHING-NOT-TRIED 
BUILDING  COUNT-POINTS 
BUILDING  COMPARE-CASES 
ADD-YQ  TRIES-WM: 

(START)  IDSK/<LISPFILES,:  DISCRIM.  ;  10 
13*-  (RUN) 


CYCLE  t 


FIRING  1 

PRODUCTION:  START-PROBLEM 
MATCHED: 

(START) 

CLEAR-DM  WM: 

CLEAR-DM  TRIES-WM: 

CLEAR-DM  CURRENT-CASE-NM: 

CLEAR-DM  THIS-CASE-WM: 

CLEAR-DM  8EST-PERF0RMANCES-WM: 

TYPE  A  PROBLEM  (OR  Q  TO  QUIT): 

::  <((NA  28)  (NB  3)  (NC  5)  (CURRENT-BEAM  HIGH-SPEED)) 


ADD-TO  TRIES-WM: 

(FAR  7.2) 

(CURRENT-BEAM  HIGH-SFEED) 
(NC  5) 

(NB  3) 

(NA  28) 

(GOAL  SATISFYING) 

ADD-TO  TRIES-WM: 
(FIRST-TRY) 

(NQT-ALTERNATIVES-SET) 
ijD-TO  WM: 
(NOT-ELIMINATED) 
(NOT-CASE-STORED) 
(NOT-PERF-KNOWN) 


CYCLE  2 


FIRING  2 

PRODUCTION:  GO-TO-SAT  I  SPY 
MATCHED: 

(FIRST-TRY) 


CYCLE  3 


FIRING  3 

PRODUCTION:  HIGH-SPEED-TARGET 
MATCHED: 

(CURRENT-BEAM  HIGH-SPEED) 
ADD-TO  WM: 

(A2  . 15' 

( B 1  2) 

(92  .2) 

(Cl  2) 

( C 2  . 15) 


CYCLE  4 


FIRING  4 

PRODUCTION:  FINISHED-P ICK ING-FIRST-PARAM-SET 
MATCHED: 

( A2  .15) 

(81  2) 
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<82  .2) 

(Cl  2) 

<C2  .15) 

ADD-TO  WM: 

(FIRST-SET) 

ADD-TO  TRIES-WM: 

(TRY  (.15  2  .2  2  .15)) 


CYCLE  5 


FIRING  5 

PRODUCT  I  ON i  FIRST-SET -IN-SATISFYING 
MATCHED: 

(GOAL  SATISFYING) 

(FIRST-SET) 


CYCLE  6 


FIRING  6 

PRODUCTION:  CHECK-PERFORMANCE 
MATCHED: 

( A2  .15) 

(NGT-PERF-KNOVIN) 

(NOT-EL IMINATED) 

( B  l  2) 

(82  .2) 

(Cl  2) 

( C 2  .15) 

(NA  26) 

(TRY  (.15  2  .2  2  .15)) 

(N8  3) 

(NC  5) 

(FAR  7.2) 

ADD-TO  NM: 

(PERFORMANCE-OK! 

(OVAM  87.71338! 

(ZQA  2.987777) 

(YQA  9.63334) 

<:<GA  8.85367) 

( W3A  24.947) 

(ZACQ  4.884436) 

(YACQ  15.57836) 

( X ACQ  38,79593) 

(NACG  65. 12283) 

(FARU  9,996] 

ADD-TO  WM: 

(PERF-KNOWN) 

DELETE-FROM  KM: 
(NOT-PERF-KNOWN) 


CYCLE  7 


FIRING  7 

PRODUCTION:  STORE -CASE-F OR-LF ARN I NG 
MATCHED: 

(PERF-KNOWN) 

(NOT-CASE-STORED) 

(A2  .15) 

( 6 1  2) 
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<B2  .2) 

(Cl  2) 

(C2  .15) 

( N A  28) 

<NB  3) 

(NC  5) 

(CURRENT-BEAM  HIGH-SPEED) 

(WACO  65.12288) 

(XACQ  38.79593) 

(YACQ  15.57836! 

(ZACQ  4.884436) 

(WQA  24.947) 

( XQA  8.85367) 

( YQA  9.83334) 

( ZQA  2.987977) 

(FARU  9.996) 

( OVAM  87.71338) 

ADD-TO  CASE-WM : 

( (28  3  5  HIGH-SPEED) 

(.15  2  .2  2  .15) 

(65. 12288 

38.79593 

15.57836 
4.884436 

24.947 
8.85367 

9.83334 
2.987977 

9.996 
87.71338! ) 

ADD-TO  THIS-CASE-WM: 

( (28  3  5  HIGH-SPEED) 

(.15  2  .2  2  .15) 

(65. 12263 

38.79593 

15.57836 
4.834436 

24.947 
8.85367 

9.83334 
2.987977 

9.996 
87.71338!  ) 

ADD-TO  CURRENT-CASE-WM: 
(CONDITIONS  (28  3  5  HIGH-SPEED)) 
ADD-TO  CURRENT-CASE-WM: 

(SETTINGS  (.15  2.2  2  . 15) ) 
ADD-TO  C'JRRENT-CASE-WM: 
(PERFORMANCES 
(65. 12288 

38.79593 

15.57836 
4.884436 

24.947 
8.95367 
9.33334 
2. 9879'7 

9.996 
87.71338 ) ) 
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ADD-TO  TRIES-WM: 

(TRIED  (.15  2.22  .15)) 
DELETE-FROM  TRIES-WM: 
(TRY  (.15  2.22  .15)) 
ADD-TO  NM : 

(CASE-STORED) 

DELETE-FROM  WM: 
(NOT-CASE-STQRED) 


CYCLE  8 


FIRING  8 

PRODUCTION:  FINISHED-SATISFYING 
MATCHED: 

(CASE-STORED) 

(PERFORMANCE-OK! 

(GOAL  SATISFYING )*****THE  PARAMETERS  FOR: 
PRINT-FIRSTS  TRIES-WM: 

(CURRENT-BEAM  HIGH-SPEED) 

<NA  28) 

(NB  3! 

(NC  5>**ARE: 

PRINT-FIRSTS  WM: 

( A2  .15) 

( B 1  2) 

( B2  .2! 

(Cl  2) 

<C2  . 1S»**MITH  PERFORMANCE  VALUES: 
PRINT-FIRSTS  WM: 

(FARU  9.995) 

(WACO  65. 12288) 

(XACQ  38.79593) 

(YACQ  15.578T6) 

(ZACQ  4.834436! 

( W3A  24.947) 

( X Q A  8.85367) 

(YQA  9.83334) 

( ZQA  2.987977) 

(OVAM  87.71338) 

CLEAR-DM  WM: 

CLEAR-DM  TRIES-WM: 

ADD-TO  TRIES-WM: 

(START) 


CYCLE  9 


FIRING  9 

PRODUCTION:  START-PROBLEM 
MATCHED: 

(START. 

CLEAR-DM  WM: 

CLEAR-DM  TRIES-WM: 

CLEAR-DM  CURRENT-CASE-WM: 
CLEAR-DM  THIS-CASE-WM: 

CLEAR-DM  BEST-PERFORMANCES- WM: 
TYPE  A  PROBLEM  (OR  Q  TO  QUIT): 
:  :  QC 


EXPLICIT  HALT 
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9  CYCLES 
9  FIRINGS 

TOTAL  CPU  SECONDS  =  51.46667 
CPU  SECONDS  PER  CYCLE  *  5.71851? 
14*- (PMTRACE  NAMES) 

SET 

154- (DMTRACE  NONE) 

SET 


204- (CALL  INPUT-SITUATION-PM) 

21 4- (ADD-TO  TRIES-WM  (START)) 

NIL 

224-  (RUN) 

FIRING  1 

PRODUCTION:  GO-TQ-SATISFY 
NO  PRODUCTION  ACCEPTABLE 
1  CYCLES 
1  FIRINGS 

TOTAL  CPU  SECONDS  =  .9333334 
CPU  SECONDS  PER  CYCLE  =  .9333334 
CPU  SECONDS  PER  FIRING  =  .9333334 
CONFLICT  SET  STATISTICS: 

SATISFYING-PM:  AVERAGE  SIZE  =  0.0,  MAXIMUM  SIZE  =  0 
INPUT-SITUATION-PM:  AVERAGE  SIZE  =  2.0,  MAXIMUM  SIZE 
FIRING  2 

PRODUCTION:  START-PROBLEM 
CLEAR-DM  WM: 

CLEAR-DM  TRIES-WM: 

CLEAR-DM  CURRENT-CASE-WM: 

CLEAR-DM  THIS-CASE-WM: 

CLEAR-DM  BEST-FERFORMANCES-WM: 

TYPE  A  PRGBLEM  (OR  Q  TO  QUIT): 

::  (((GOAL  OPTIMIZING)  (NA  28)  (NB  3)  (NC  5) 
(CURRENT-BEAM  OTHER) ) 


NO  PRODUCTION  ACCEPTABLE 
0  CYCLES 
2  FIRINGS 

TOTAL  CPU  SECONDS  =6.0 
CPU  SECONDS  PER  CYCLE  =  UNDEFINED 
CPU  SECONDS  PER  FIRING  =  3.0NIL 
23  4-  (CONTINUE) 


FIRING  3 
PRODUCTION: 
FIRING  4 
PRODUCTION: 
FIRING  5 
PRODUCTION; 
FIFING  6 
PRODUCTION: 
FIRING  7 
PRODUCTION: 
FIRING  8 


OTHER-SIT 

FINISHED-F I CKING-FIRST-P ARAM-SET 


F0R-0PTIMIZIN6-0R -MONITORING 


CHECK -PERFORMANCE 
STORE- CASE-FOP- LEARNING 


G-7 


PRODUCTION:  FIRST-OPTIMIZ ING-TRY 
CLEAR-DM  BEST-PERFORMANCES-WM: 

♦♦♦♦♦THE  PARAMETERS  FOR: 

PRINT-FIRSTS  TRIES-WM: 

(CURRENT-BEAM  OTHER) 

(NA  28) 

(NB  3) 

(NC  5) 

♦♦ARE: 

PRINT-FIRSTS  WM: 

( A2  .15) 

( B 1  2) 

(B2  .2) 

(Ct  2) 

<C2  .2) 

♦♦WITH  PERFORMANCE  VALUES: 

PRINT-FIRSTS  WM: 

(WACO  69.43424) 

( X ACQ  42.86835) 

(VACQ  13.30S46) 

(ZACQ  5.498253) 

( W Q A  28.43384) 

( XSA  10.81022) 

1 YQA  4.339954) 

(ZQA  3.009685) 

(FARU  9.996) 

( QVAM  90.5962) 

FIRING  9 

PRODUCTION:  TRY-ANYTHING-NOT-TRIED 
CLEAR-DM  WM: 

FIRING  10 

PRODUCTION:  CHECK-PERFORMANCE 
FIRING  11 

PRODUCTION:  STORE-CASE -FOR-LEARNING 
FIRING  12 

PRODUCTION:  TRY-ANYTHING-NDT-TRIED 
CLEAR-DM  WM: 

FIRING  13 

PRODUCTION;  CHECK-PERFORMANCE 
FIRING  14 

PRODUCTION:  STORE-CASE-FOR-LEARNING 
FIRING  15 

PRODUCTION:  TRY-ANYTHING-NOT-TRIED 
CLEAR-DM  WM: 

FIRING  16 

PRODUCTION;  CHECK-PERFORMANCE 
FIRING  17 

PRODUCTION:  S70RE-CASE-FQR-LEARNING 
FIRING  18 

PRODUCTION:  TRY-ANYTHING-NOT-TRIED 
CLEAR-DM  WM: 

FIRING  19 

PRODUCTION:  CHECK-PERFORMANCE 
FIRING  20 

PRODUCTION:  STORE-CASE-FOR-LEARNING 
FIRING  21 

PRODUCTION:  CHECK -F0R-0VERALL-BE5T-S0-FAR 
CLEAR-DM  BEST-PERFORMANCES-WM: 

♦  ♦*■*  *THE  PARAMETERS  FOR: 


PRINT-FIRSTS  TRIES-WM: 

(CURRENT-BEAM  OTHER) 

(NA  28) 

(NB  3) 

(NC  5) 

♦♦ARE: 

PRINT-FIRSTS  WM: 

( A2  .15) 

<B1  2) 

( B2  .2) 

(Cl  2) 

( C 2  .15) 

♦♦WITH  PERFORMANCE  VALUES: 

PRINT-FIRSTS  WM: 

(WAC3  65.  12286) 

( X ACQ  38.79593! 

(YACQ  15.57336! 

(ZACQ  4.884436! 

(WQA  24.947) 

( X (2 A  8.85367! 

( Y Q A  9.83334) 

( ZQA  2.987977) 

(FARU  9.996) 

(OVAM  87.71338! 

FIRING  22 

PRODUCTION;  TRY- ANYTH  I  NS- NOT- TRIED 
CLEAR-DM  WM: 

FIRINS  23 

PRODUCTION;  CHECK-PERFORMANCE 
FIRING  24 

PRODUCTION:  STORE-CASE-FOR-LEARNING 
FIRING  25 

PRODUCTION:  TRY-ANYTHING-NQT-TRIED 
CLEAR-DM  WM: 

FIRING  26 

PRODUCTION:  CHECK-PERFORMANCE 
FIRING  27 

PRODUCTION:  STQRE-CASE-FOR-LEARNING 
FIRING  28 

PRODUCTION:  TRY-ANYTHIN5-N0T-TRIED 
CLEAR-DM  WM: 

FIRING  29 

PRODUCTION:  CHECK-PERFORMANCE 
FIRING  30 

PRODUCTION;  STORE-CASE-FOR-LEARNING 
FIRING  31 

PRODUCTION:  CHECK-F3R-QVERALL-BEST-SO-FAR 
CLEAR-DM  BEST- PERFORM ANCES-WM: 

♦♦♦♦♦THE  PARAMETERS  FOR: 

FRINT-FIRSTS  TRIES-WM: 

(CURRENT-BEAM  OTHER) 

(NA  28! 

(NB  3) 

(NC  5) 

♦♦ARE: 

PRINT-FIRSTS  WM: 

<A2  .15) 

( B  1  2) 

(32  .2) 
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(Cl  1) 

(C2  .2) 

**WITH  PERFORMANCE  VALUES: 
PRINT-FIRSTS  WM: 

(WACQ  60.41958) 

(XACQ  34.56657) 

(YACQ  12.92509) 

(ZACQ  4.675394) 

( WQA  21.47368) 

<  XQA  7.028516) 

( YQA  12.92509) 

(ZQA  4.675394) 

(FARU  9.996) 

(OVAM  84.24534) 

FIRING  32 

PRODUCTION:  TRY-ANYTHING-NQT-TRIED 
CLEAR-DM  WM: 

FIRING  33 

PRODUCTION:  CHECK-PERFORMANCE 
FIRING  34 

PRODUCTION:  STORE-CASE -FOR-LEARNING 
FIRING  35 

PRODUCTION:  TRY-ANYTHING-NQT-TRIED 
CLEAR-DM  WM: 

FIRING  36 

PRODUCTION:  CHECK-PERFORMANCE 
FIRING  37 

PRODUCTION:  STORE-CASE-FOR-LEARM I NG 
FIRING  38 

PRODUCTION:  TRY-ANYTHING-NQT-TRIED 
CLEAR  — DiM  WM: 

FIRING  39 

PRODUCTION:  CHECK -PERFORMANCE 
FIRING  40 

PRODUCTION:  STORE-CASE-FOR-LEARNING 
FIFING  41 

PRODUCTION:  TRY-ANYTHING-NQT-TRIED 
CLEAR-DM  WM: 

FIRING  42 

PRODUCTION:  CHECK-PERFORMANCE 
FIRING  43 

PRODUCTION:  STORE-CASE-FOR-LEARNING 
FIRING  44 

PRODUCTION:  TRY-ANYTHING-NQT-TRIED 
CLEAR-DM  WM: 

FIRING  45 

PRODUCTION;  CHECK-PERFORMANCE 
FIRING  46 

PRODUCTION:  STORE-CASE -FOR- LEARNING 
FIRING  47 

PRODUCTION:  TRY- ANYTH  IN  3- NOT -TRIED 
CLEAR-DM  WM: 

FIRING  48 

PRODUCTION:  CHECK-PERFORMANCE 
FIRING  49 

PRODUCTION:  STORE-CASE-F OR- LEARNING 
FIRING  50 

PRODUCTION:  TR Y -  ANYTH  I NG-NOT- TRIED 
CLEAR-DM  WM: 
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F I R I N3  51 

PRODUCTION;  CHECK-PERF ORMANCE 
FIRING  52 

PRODUCTION:  STORE-CASE- FOR- LEARNING 
FIRING  53 

PRODUCTION:  TRY-ANYTHING-NOT-TRIED 
CLEAR-DM  WM: 

FIRING  54 

PRODUCTION;  CHECK-PERFORMANCE 
FIRING  55 

PRODUCTION;  ST0RE-CASE-FGR-LEASNIN3 
FIRING  56 

PRODUCTION:  TRY-ANYTHINS-NOT-TRI ED 
CLEAR-DM  WM: 

FIRING  57 

PRODUCTION:  CHECK-PERF  DRHA N C E 
FIRING  55 

PRODUCTION:  STORE-CASE-- 3R-LE ARM  I  MO 
FIRING  5s? 

PRODUCTION:  TRY-ANY'H • N6-NG7-TR I  ED 
CLEAR-DM  WM: 

FIRING  63 

PRODUCTION:  CHECK-PERFORMANCE 
FIRING  61 

PSQDUCT ION:  STORE-CASE -F OR-LEARN  IMG 
FIRING  62 

PRODUCT  I  ON:  TRY- A:iVT-  !  YG-MGT  -T?  I  ED 
CLEAR -DM  WM: 


FIRING  63 
PRCDUCr  ION: 

CHEC  '-FEE7  DRM'ANCE 

FIRING  64 
PRODUCTION: 

3  •  0  ■  E  -  C  A  3  Z  -  F  C  T  -  _  ■  A  R  N I  s'  G 

F'R'NG  -2 
PRODUCTION: 

TR ANYTH  I NG-NO“- TP  I  ED 

CLEAR-DM  WM: 

FIRING  66 
PRODUCTION: 

CHECK-PERFORMANCE 

FIRING  67 
PRODUCTION: 

STORE-CAEE-FOR-LZARNINC 

FIRING  68 
PRODUCT  0  N : 

T  R  V -  A  H : THI H 3 -NjT-TRIEO 

CLEAR-DM  WM: 

FIRING  69 
PRODUCT  ION : 

CHECK-PERFORMANCE 

FIRING  72 
PRODUCT  10  IN  ; 

STORE- CASE- FOR -.EARN  I NC 

FIRING  71 
PRODUCTION: 

T“V-ANYT« I NG- NO  I  ED 

cleat  -dm  lm 

FIRING  70 
PRODUCTION: 

CHECK-PERFORMANCE 

FIFING  73 
PRODUCTION: 

S TORE -C AS E-cOP -LEARNING 

FIRING  74 
PRODUCTION: 

T  R  Y  ■ -  A  :t  Y  T  H I  M  3  -  M  O'- TRIED 

CLEAR-DIM  WM: 

FIRING  75 
PRODUCTION. 

CHECK -PERFORMANCE 

FIRING  76 

G-ll 


PRODUCTION:  STORE-C A 5E-F0R- LEARNING 
FIRING  77 

PRODUCTION:  TRY-ANYTHIN3-N0T-TR r ED 
CLEAR-DM  W« : 

FIRING  78 

PRODUCTION:  CHECK-PERFORMANCE 
FIRING  79 

PRODUCTION:  STORE-CASE- FOR -LEARNING 
FIRING  80 

PRODUCTION:  TRY-ANYTHIN5-NQT -TRIED 
CLEAR-DM  WM : 

FIRING  81 

PRODUCTION:  CHECK-PERFORMANCE 
FIRING  82 

PRODUCTION:  STORE  -CASE-FOR-LEARNING 
FIRING  S3 

PRODUCTION:  TRY-ANYTHI NG-NOT-TRIID 
CLEAR-DM  WMs 
FIRING  34 

PRODUCTION:  CHECK- PERFORMANCE 
FIRING  95 

PRODUCTION:  STORE-C ASE-FQR- LEARN  I  NS 
FIRING  9S 

PRODUCTION:  TRY- ANYTH  I NS-NOT-TR I  ED 
CLEAR-DM  Wfl: 

24-- (CALL  INPUT -S ITUAT ION-PM) 

MIL 

25 f-  (CLEAR-DM  TRIIS-NM! 


CLEAR-DM  TRIES-WM: NIL 

264- (ADD-TG  TRIES-WM  (START!) 

NIL 

27  4-  (RLi N . 

FIRING  1 

PRODUCTION:  START-PROBLEM 
CLEAR-DM  WM: 

CLEAR-DM  TRIE3-WM: 

CLEAR-DM  CURRENT -CASE- WM: 
CLEAR-DM  THIS— CA3E-WM: 

CLEAR-DM  SEST-PERF0RMAMCE3-WM: 
TYPE  A  PROBLEM  (OP  Q  TO  QUIT): 
::  ( ( (NA  36!  i 


FIRING  2 
?  P.  C !?  *J  C  7 1 C  M : 

30-T0-9ATISFY 

FIRING  3 
PRODUCTION; 

DEFAULT-SIT 

FIRING  4 
PRODUCTION: 

FINISHED-PICKING -FIRST-PAR AM 

FIRING  5 
PRODUCTION: 

F  I R ST-SET-IN -SATISFYING 

FIRING  6 
PRODUCTION: 

CHECK-PERFORMANCE 

FIRING  7 
PRODUCTION: 

ST  ORE-CASE -  FOR. -LEARN  INS 

G-12 


FIRING  8 

PRODUCTION:  FINI3nED-SA7ISFYIN3*****THE  PARAMETERS  FOR; 
PRINT-FIRSTS  TRIES-WM: 

(CURRENT-BEAM  DEFAULT) 

(NA  36) 

(NB  8) 

<NC  0) ♦♦ARE: 

PRINT-FIRSTS  WM: 

( A2  . 15) 

(81  2) 

(B2  .2! 

(Cl  1) 

<C2  .2)  **WITK  PERFORMANCE  VALUES: 

PRINT-FIRSTS  WM: 

(FARU  9.996) 

(WACO  49.88607) 

(XACQ  25.73632) 

(YACQ  S, 02063! 

(ZACS  4.130924) 

(WQA  0) 

( XQA  0) 

( YCA  O' 

(ZQA  3.1 

(OVAM  31.951*9) 

CLEAR-DM  WM: 

CLEAS-DM  TR:fs-wmj 
FIRING  9 

PRODUCTION:  START  -PROBLEM 
CLEAR-DM  WM: 

CLEAR-DM  TRIES-WM: 

CLEAR-DM  CURRENT-CASE-KM: 

CLEAR- Oil  THl 3-CASc-WM: 

C  L  £  A  F:  -  D  M  5  £  3  T  -  P  E  R  F  0  F  M  A  N  C  E  S  -  W  M  : 

TYPE  A  PROBLEM  (OR  Q  TO  QUIT): 

: :  (((NA  32)  (NC  4)  (CURRENT-BEAM  OTHER)) 


FIRING  13 
PRODUCTION: 
FIRING  11 
PRODUCTION: 
FIRING  12 
PRODUCTION: 
FIRING  13 
PRODUCTION: 
FIRING  14 
PRODUCTION: 
FIRING  15 
PRODUCTION: 
FIRING  16 


60-T0-SATISFY 

OTHER-SIT 

FINISHED- PICK  INK-FIRS"-? A RAM-3E 
FIR3T-SE"- IN- SATISFYING 
CHECK-PERFORMANCE 
STORE-CASE -FOR -LEARNING 


PRODUCTION:  FINISHED-SAT:3FYING**-««*7H2  PAR  A. ME 
PRINT-FIRSTS  TRIES-WM: 

(CURRENT-BEAM  OTHER) 

(HA  32) 

(N3  0: 

(NC  4) **AR£: 


PRINT-FIRS'S  WM: 


RS  FOR: 
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( A2  .15) 

( B 1  2) 

(B2  .2) 

(Cl  2) 

(C2  . 2) **WITH  PERFORMANCE  VALUES: 
PRINT-FIRSTS  WM: 

(FARU  9.996) 

(WACQ  60 . 41958) 

(XAC8  34.5665c) 

(YACQ  12.9233?) 

( ZAC3  4,675394) 

(NO  A  3) 

( XQA  0; 

( YQA  3.903664) 

( ZQ  A  2.556644:' 

( 0 V A M  44.63296: 

CLEAR-DM  WM: 

CLEAR-DM  TRIES-WM: 

FIRING  17 

PRODUCTION;  £T ART-PROBLEM 
CLEAR-DM  WM: 

CLEAR-DM  TRIES -NM: 

CLEAR-DM  CURRENT -CASE-NM: 

CLEAR-DM  THIS-CASE-WM: 

CLEAR -DM  BEST -PERFORMANCE i -MM i 
TYPE  A  PROBLEM  (OR  Q  TO  QUIT): 

::  (  :  (NA  32.  INC  4); 


FIRING  13 

PRODUCTION:  G0-TQ-3ATI3F  / 

FIRING  l? 

PRODUCTION:  DEFAULT-SI" 

FIRING  23 

PRODUCTION:  FINiSHED-PICKINS-FIRST-PAP,  AM-SET 
FIRING  21 

PRODUCTION:  FIRST-SET-IN-SATISFYING 
FIRING  22 

product: on ;  check-performance 

FIRING  23 

CRGDUCT I  CM :  S T ORE-CASE- FOR- LEARN  INS 
FIRING  24 

PRODUCTION:  FINISHED-SATISFYING*****^  PARAHE'ERd  -OR 
PRINT-FIRSTS  TRIES-WM: 

(CURRENT-BEAM  DEFAULT' 

O.’A  32! 

;nd  3 

( NC  4;**AFE: 

PRINT-FIRSTS  WM: 

( A2  .13) 

(SI  2 ) 

(32  .2' 

( C  I  1 : 

(C2  .2:  ♦•♦WITH  PERFORMANCE  VALUES; 

PRINT-FIRSTS  WM: 

(FARU  0.996' 

(WACO  52. 1 1901 1 
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( X ACQ  27.53143? 

<  YACQ  8 . 944376  > 

(2ACQ  4.288123? 

( WQA  0) 

(X9A  0) 

(YGA  6. 944876) 

(ZQA  4.2B9123) 

(CVftM  46.45111) 

CLEAR-DM  NM: 

CLEAR-DM  TRIES-WM: 

FIRING  25 

PRODUCTION!  START-PROBLEM 
CLEAR-DK  WM: 

CLSAR-DM  TRIE3-WM: 

CLEAR-OM  CURREN7-CASE-WM: 

CLEAR -DM  THIS-CAEE-WN: 

CLEAR -DM  BE5T-PERF  ORMAN'CES-WM: 
TYRE  A  PROBLEM  LOR  3  TO  3UITJ  t 
:  :  ■  (  SNA  25)  (NB  5)  (MC  6)  ) 


FIRING  26 
PRODUCTION: 
FIRING  27 
PRODUCTION: 
FIRING  29 
PRODUCTION: 
FIRING  2? 
PRODUCTION: 
FIRING  30 
PRODUCTION: 
FIRING  31 


SO-TO-SAT  I3FY 
DEFAULT'S  17 

FINISHED-PICK  I NG-FIRST-PARA, 

FIRST-SET-IN-SATISFYING 

CHECK-PERFORMANCE 


PRODUCTION:  STORE -CASE -FOR -LEARNING 
FIRING  32 

PRODUCT ION:  FINISHED-SATISFYING*  ♦  m»7HC 
PRINT-FIRE'S  TRIES-WM: 

( C U RRSNT-BSAM  DEFAULT / 


(NA  25) 


PSRAM.E'ERE 


(N3  5: 


( NC  6 ) ** ARE : 

PRINT-FIR S'G  WM: 

(AC  .15! 

(21  2 

( t  0  .2) 

(Cl  1  ! 

(CO  .  J  PERFORMANCE  VALUES: 

PRINT-FIRSTS  WM: 

(FARU  9.996 


(WACO  65.57399) 
( X  ACQ  39.2195) 
(YACQ  15.84S52) 
( Z 4.90414?! 
(KOA  25.2=35) 

( XOA  9.8439? 

( Y  C  A  15.E4852! 
(ZQA  4.?0iiJ9 
(CVAP  96 . a7566 ! 
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CLEAR -DM  WM: 

CLEAR-DM  TRIES— WM: 

FIRING  33 

PRODUCTION:  START-PROBLEM 
CLEAR-DM  NM : 

CLEAR-DM  TRIE3-VIM: 

CLEAR-DM  CURRENT-CASE-WM: 

CLEAR-DM  THIS-CASE-WM: 

CLEAR-DM  BEST- PERFORM A NCES-WM: 

TYPE  A  PROBLEM  (OR  Q  TO  QUIT): 

::  <((NA  33)  (MB  2)  <NC  2)  (CURRENT-BEAM  HIGH-SPEED)) 


FIRING  34 


PRODUCTION: 
PIPING  35 

60-TO-5ATI3FY 

PRODUCTION; 
FIRING  36 

HIGH-SPEED-TARGET 

PRODUCTION ; 
F  I P  I N  5  3  7 

FINISHED-? ICXIK3-FI33T- 

PRODUCTION; 
FIRING  33 

F IRST-5ET- IN-SA? ISFYIH3 

PRODUCTION: 
FIRING  3? 

C  H  E  C  K -PERFORMANCE 

PRODUCTION; 
FIRING  43 

s"ore-case--or-leasn:n3 

PRODUCTION: 

f INI  SHED-SAT  1 SPY »N6<*** 

PRINT-FIRST 

3  TRItS-MM: 

2 CURRENT -SEAM  HIGH-SPEED ' 
( M A  33) 

(MB  1) 

(NC  2! ♦♦ARE: 

PR  I  NT -F  I  R3r 5  WM : 

•'■r.2  .  1  S  ; 

"91  2 : 


;  >  a  *4  _ 


* THE  FARAME 


r  j 


(22  ,2! 


(C2  .15) 

I  TH  PERFOf. 

PRINT— F  I 

;CT.-  .,1  M  . 

(FARU  9. 

gg5> 

CHAOS  53 

.  S  7  2 1 A ) 

( X  A  2  G  30 

.  64332: 

(Y4C3  10 

,  6  3  o  5  9 ) 

CZAC3  4. 

466"53 ) 

(WQA  18. 

3  .s  3  2  4  j 

(X3A  5.5 

23635  • 

( Y 0 A  6.2 

33452) 

(ISA  2.5 

2  6  2  5  i ' 

( CV  Ail  6  3 

.35239) 

CLEAR-DM 

W  M : 

CLEAR-DM 

TRIE3-WM: 

FIRING  4 

1 

PRODUCT  I 

ON;  START-PRO 

CLEAR-DM 

VIM ; 

CLEAR-DM 

TRIES-HM: 

CLEAR-DM 

CURRENT-CASE 

CLEA- -DM 

THIS-CASE-WM 
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CLEAR-DM  BEST- PERFORM ANCES-WM: 

TYPE  A  PROBLEM  (OR  Q  TO  QUIT): 

::  (((GOAL  LEARNING)  <NA  32)  (NB  1)  (NC  3) 
(CURRENT-BEAM  OTHER)) 


FIRING  42 

PRODUCTION:  SO-TG-5AT ISFY 
FIRING  43 

PRODUCTION;  OTHER-SIT 
FIRING  44 

PRODUCTION:  FINISHED-PI  OKI NG-F I Ra^-PAPAM-SET 
FIRING  45 

PRODUCTION:  FOR-LEARNING 
FIFING  46 

PRODUCTION;  CHECK-PERFORMANCE 
FIRING  47 

PRODUCTION:  STORE-C AS E-F 3R-LE ARN I NS 
NO  PRODUCTION  ACCEPTA9L£ 

33  CYCLES 
a,7  FIRINGS 

TOTAL  C'"J  SECONDS  =  163.1333 
CPU  SECONDS  PER  CYCLE  =  5. 99494? 

29*-  !  =  M7RACS  FULL) 

SEI- 

30 *r  (3N7RACE  FULL) 

S£T 

31  v-  (CONTINUE) 


CYCLE  34 

PRINT-CONTENTS  CASE-VIM; 

((32  1  3  OTHER) 

(.15  2  .2  2  .2) 

<60. 41956 
34.56557 
12.92509 
4 .  5  7  5  3  9  4 
21 . 47363 
7.328516 
3. 933664 
2.336645 
9.996 
73.10517!  ; 

( (33  1  2  HIGH-SPEED) 
(.13  2  .2  2  .15) 
(53.37254 
33,64332 
10.63639 
4.466753 
IE. 36324 
5 , 523635 
6.238438 
2.526251 
9.996 
68.05239:  ) 
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((25  5  6  DEFAULT) 

(.15  2  .2  1  .2) 

(65. 57398 
39.2105 
15.84852 
4.904149 
25.2938 
9.0439 
15.84852 
4.904149 
9.  996 

96.47066) ) 

((32  0  4  DEFAULT) 

(.15  2  .2  t  .2) 

<52.11901  27.53143  8.944376  4.289123  0  0  8.944876  4.299123 
9.996  46.45111) ) 

( ! 32  0  4  OTHER ) 

(.15  2  .2  2  .2) 

<60.41953  34.56656  12.9253°  4.675394  3  0  3.933664  2.556644 
9.996  44. 60296)  ! 

(136  0  0  DEFAULT) 

(.15  2  .2  1  .2) 

(49,58637  25.73632  9.32363  4.183924  0300  °.°°6  31.°51°° 
)  ) 

(  (26  3  5  O’HER)' 

(.1  2  .2  1  .15) 

(124.5331 
42. 36235 
81  .  a7513 
5.244219 
10.44601 
4.449867 
21.45127 
3.984175 
9.  ?9o 


114.176') 

( (23  3  5  OTHER) 

( .  15  2  .2  1  .2! 
(60.41958 
34.56657 
12.92509 
4.  673394 
21  .  47363 
7.026516 
12. 9253? 

4.675394 
9.  99-5 

84.245*4) > 

('23  3  5  O'HER) 
(.15  2  .15  2  ,15) 
(42.  34361 
36.  27632 
13. 97472 
4.7617 
51.  39486 
9.349092 
B.  633526 
2,348546 
9.  996 
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111.5*6)  ) 

((26  3  5  OTHER) 
(.15  2  .15  2  .2) 
(66.90707 
40.44466 
16.66322 
4.96208 
55.91216 
11.46770 
4.217375 
2.879794 

9.996 
116.7174)) 

( (28  3  5  OTHER) 
(.15  2  .2  2  .15 
(65.  12283 
38. 79593 
15. 57836 
4.2S4436 
2^.947 
8.35367 
9. 33334 
<? _  037977 

9.996 
87.71338) ) 

((28  3  5  OTHERS 
<  .2  1  .2  1  .2) 
(67.77925 
41.25932 
17.20951 
4.999721 
67.77925 
41 . 25932 
17.23951 
4 . 999721 

9.996 
174.0537) ) 

((23  3  5  OTHER) 
(.2  2  .2  1  .2! 
(72.74717 
46 . 00702 
29 ■ 52497 
6.5561  IT 
31.1 303 
12. 450S6 
20.52497 
6.5561  13 

9.996 
117.1171:  ! 

((23  3  5  OTHER) 

( . 2  2  .2  2  .2) 
■'00.1  1359 
53.37366 
26.09974 
9.490366 
37.75434 


1 

1 

i 


4 


9.996 

1 15. 16*4) ) 

( <2B  3  5  OTHER) 

(.15  2  .2  2  .2) 

(69.48484 

42.86885 

18.30846 

5.498253 

28.40084 

10.81022 

4.339954 

3.009685 

9.996 

90.5968) 

( (28  3  5  HI5H-SPEED) 

(.15  2  .2  2  .15) 

(65. 12289 
38.79593 
15.57336 
4 . 954436 
2-1.947 
S . 83367 
9.83334 
2.957977 
9.  =96 

87.71338) ! 

PRINT -CONTENTS  CURRENT-CASE-WH: 
(PERFORMANCES 
(63.41958 
34.56457 
12.9253° 

4.675394 
21 . 47362 
7.028316 
3.903664 
2.556645 

9.996 

73.10517)) 

(SETTINGS  (.15  2  .2  2  .2!) 
(CONDI T IONS  (32  l  3  OTHER)) 
PRINT-CONTENTS  WK: 

(CASS-STORED! 

(PERF-KNCWM5 
(FAR U  9.996) 

(WACO  60.4,955' 

! XACQ  3d. 56637) 

(VACO  12.92509) 

(ZACS  4.675394) 

( W Q  A  21.47365) 

( X Qfi  7.328316) 

(VGA  3.903664) 

( ZQA  2.536645! 

(OVAM  73. 10517) 

(PERFORMANCE -OK? 

(  p  I  ?:  S  T  -  3  2  7  ) 

(C  2  .2 
(Cl  7) 

(82  .2) 

(81  2! 


4 


« 


« 


M 
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I 


